-- Logs begin at Wed 2022-08-24 13:40:47 UTC, end at Wed 2022-08-24 15:07:47 UTC. -- Aug 24 14:29:11.439827 dv-cinder-756710-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 14:29:11.449285 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 14:29:11 2022] *** Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: nodename: dv-cinder-756710-6-iscsi Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: machine: x86_64 Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: clock source: unix Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: pcre jit disabled Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: detected number of CPU cores: 4 Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: current working directory: / Aug 24 14:29:11.451292 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: detected binary path: /usr/bin/uwsgi-core Aug 24 14:29:11.451866 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: your processes number limit is 47680 Aug 24 14:29:11.451866 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: your memory page size is 4096 bytes Aug 24 14:29:11.451866 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: detected max file descriptor number: 2048 Aug 24 14:29:11.451866 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: lock engine: pthread robust mutexes Aug 24 14:29:11.451866 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: thunder lock: enabled Aug 24 14:29:11.451866 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 14:29:11.451866 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 14:29:11.490116 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: Python main interpreter initialized at 0x55e0e82479c0 Aug 24 14:29:11.490116 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: python threads support enabled Aug 24 14:29:11.490116 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: your server socket listen backlog is limited to 100 connections Aug 24 14:29:11.490116 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: your mercy for graceful operations on workers is 90 seconds Aug 24 14:29:11.490443 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 14:29:11.491006 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: *** Operational MODE: preforking *** Aug 24 14:29:11.491266 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: *** uWSGI is running in multiple interpreter mode *** Aug 24 14:29:11.491266 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: spawned uWSGI master process (pid: 106208) Aug 24 14:29:11.491449 dv-cinder-756710-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 14:29:11.493634 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: spawned uWSGI worker 1 (pid: 106209, cores: 1) Aug 24 14:29:11.493634 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: spawned uWSGI worker 2 (pid: 106210, cores: 1) Aug 24 14:29:11.493634 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 14:29:12.188835 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:29:12.190496 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:29:13.280374 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:29:13.280374 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: from cryptography.utils import int_from_bytes Aug 24 14:29:13.280910 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:29:13.280910 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: from cryptography.utils import int_from_bytes Aug 24 14:29:13.283651 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:29:13.283651 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: from cryptography.utils import int_from_bytes Aug 24 14:29:13.284074 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:29:13.284074 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: from cryptography.utils import int_from_bytes Aug 24 14:29:15.852191 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:29:15.852757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:29:15.852853 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:29:15.853187 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:29:15.853264 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:29:15.853344 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:29:15.853496 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:29:15.853589 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:29:15.853907 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:29:15.854023 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.854169 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:29:15.854270 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.854564 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.854663 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.854897 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.854992 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.855225 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.855321 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.855534 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.855628 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.855857 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.855961 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.856178 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.856282 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.856501 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.856605 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.856757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.856852 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.857074 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.857168 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.857398 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.857495 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756710-6-iscsi {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.857722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.857833 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.858058 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.858152 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756710-6-iscsi {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.858371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.858525 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.858692 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.858788 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.858997 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.859091 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.859320 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.859417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.859624 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.859717 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.859963 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.860141 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.860549 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.860690 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.860799 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.860922 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.861084 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.861253 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.861385 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.861582 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.861696 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.861924 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.862068 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.862238 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.862389 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.862562 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.862711 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.862874 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.863038 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.863198 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.863353 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.863510 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.863681 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.863910 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756710-6-iscsi {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.864061 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.864230 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.864375 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756710-6-iscsi {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.864546 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.864690 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.864861 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.865009 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.865278 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.865366 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.865594 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.865735 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.865930 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.866084 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.866254 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.866400 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.866565 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.866728 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.866874 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.867056 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.867201 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.867371 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.867527 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.867704 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.867872 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.868231 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.868348 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.868437 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.868569 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.868763 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.868860 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.869073 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.869164 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.869387 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.869482 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.869689 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.869809 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.870024 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.870114 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.870275 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.870371 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.870584 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.870682 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.870875 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.870971 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.871188 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.871277 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.871516 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.871614 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.871765 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.871859 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.872016 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.872407 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.872585 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.872685 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.872908 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.872998 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.873213 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.873304 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.873521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.873616 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.873849 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.873952 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.874159 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.874295 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.874497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.874584 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.874809 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.874896 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.875123 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.875229 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.875428 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.875521 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.875737 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.875836 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.876047 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.876150 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.876369 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.876454 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.876689 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.876791 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.877014 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.877111 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.877327 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.877454 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.877655 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.877772 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.878025 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.878124 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.878333 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.878432 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.878645 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.878739 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.878970 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.879070 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.879292 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.879389 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.879605 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.879702 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.879911 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.880005 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.880219 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.880308 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.880527 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.880621 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.880843 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.880936 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.881155 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.881241 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.881473 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.881558 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.881727 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.881846 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.882049 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.882138 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.882355 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.882442 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.882674 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.882762 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.882982 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.883077 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.883285 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.883880 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.884101 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.884187 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.884412 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.884516 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.884739 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.884835 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.885047 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.885143 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.885354 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.885448 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.885661 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.885777 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.885993 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.886082 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.886299 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.886386 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.886605 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.886703 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.886912 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.887006 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.887223 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.887318 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.887535 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.887635 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.887846 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.887933 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.888149 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.888247 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.888456 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.888544 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.888761 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.888858 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.889068 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.889162 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.889376 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.889464 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.889684 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.889790 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.890015 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.890105 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.890335 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.890431 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.890637 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.890730 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.890943 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.891039 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.891258 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.891356 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.891564 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.891650 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.891868 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.891963 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.892182 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.892270 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.892494 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.892589 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.892821 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.892913 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.893126 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.893215 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.893436 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.893524 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.893804 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.893897 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.894066 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.894150 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.894370 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.894537 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.894676 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.894763 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.894983 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.895070 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.895286 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.895371 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.895593 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.895695 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.895896 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.895984 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.896201 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.896287 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.896508 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.896613 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.896825 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.896911 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.897142 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.897229 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.897450 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.897550 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.897774 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.897863 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.898091 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.898180 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.898415 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:29:15.898515 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.898757 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.898851 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.899621 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.899719 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.900046 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.900202 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.900387 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.900529 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.900714 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.900872 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.901033 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.901215 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.901352 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.901544 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.901683 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.901891 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.902025 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.902214 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.902343 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.902550 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.902659 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.902877 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.902971 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.903198 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.903288 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.903519 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.903608 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.903846 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.903947 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.904171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.904258 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.904508 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.904660 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.904822 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.904909 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.905140 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.905234 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.905463 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.905550 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.905802 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.905923 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.906118 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.906211 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.906454 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.906541 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.906783 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.906910 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.907101 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.907197 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.907429 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.907522 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.907754 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.907848 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.908068 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.908156 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.908384 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.908480 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.908699 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.908786 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.909026 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.909127 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.909352 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.909447 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.909665 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.909773 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.910013 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.910101 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.910325 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.910433 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.910659 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.910759 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.910955 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.911055 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.911268 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.911364 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.911582 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.911670 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.911901 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.911987 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.912221 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.912317 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.912538 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.912624 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.912855 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.912954 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.913177 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.913305 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.913492 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.913580 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.913832 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.913925 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.914148 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.914238 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.914456 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.914543 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.914792 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.914882 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.915181 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.915283 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.915490 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.915585 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.915800 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.915887 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.916114 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.916218 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.916434 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.916534 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.916747 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.916842 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.917076 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.917169 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.917382 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.917469 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.917696 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.917878 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.918037 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.918133 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.918353 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.918441 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.918661 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.918761 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.918976 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.919064 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.919292 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.919388 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.919599 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.919700 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.919916 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.920003 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.920226 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.920309 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.920534 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.920617 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.920862 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.920969 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.921171 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.921260 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.921479 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.921568 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.921824 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.921916 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.922138 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.922225 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.922452 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.922542 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.922765 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.922850 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.923082 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.923170 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.923400 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.923494 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.923716 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.923802 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.924033 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.924127 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.924371 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.924468 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.924695 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.924830 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.925001 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.925097 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.925329 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.925472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.925658 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.925762 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.926009 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.926109 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.926318 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.926406 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.926636 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.926944 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.927040 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.927251 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.927349 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.927560 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.927668 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.927872 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.927968 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.928179 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.928267 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.928489 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.928577 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.928796 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.928886 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.929101 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.929189 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.929408 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.929505 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.929717 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.929843 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.930052 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.930152 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.930895 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.931008 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.931232 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.931321 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.931538 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.931631 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.931852 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.931947 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.932189 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.932275 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.932518 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.932605 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.932860 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.932954 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.933180 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.933266 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.933505 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.933598 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.933848 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.933953 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.934174 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.934266 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.934490 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.934578 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.934808 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.934946 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.935124 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.935219 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.935438 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.935532 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.935760 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.935855 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.936074 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.936159 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.936392 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.936485 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.936704 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.936792 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.937026 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.937112 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.937339 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.937446 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.937661 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.937765 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.937993 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.938092 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.938314 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.938402 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.938659 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.938832 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.938974 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.939071 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.939304 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.939408 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.939652 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.939742 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.939993 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.940089 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.940311 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.940407 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.940626 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.940714 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.940942 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.941030 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.941256 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.941353 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.941570 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.941699 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.941894 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.941977 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.942218 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.942325 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.942537 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.942631 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.942851 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.942939 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.943172 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.943268 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.943481 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.943566 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.943802 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.943898 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.944108 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.944197 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.944424 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.944512 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.944746 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.944845 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.945057 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.945146 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.945379 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.945475 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.945689 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.945806 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.946597 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.946695 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.946923 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.947019 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.947245 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.947395 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.947572 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.947771 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.947891 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.947979 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.948197 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.948360 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.948512 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.948601 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.948823 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.948916 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.949134 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.949230 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.949446 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.949535 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.949789 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.949891 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.950092 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.950193 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.950402 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.950490 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.950709 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.950798 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.951015 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.951111 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.951329 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.951415 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.951642 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.951731 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.951952 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.952054 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.952266 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.952352 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.952590 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.952677 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.952903 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.953047 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.953210 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.953311 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.953534 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.953623 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.953868 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.953971 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.954178 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.954266 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.954485 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.954573 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.954791 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.954888 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.955107 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.955192 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.955418 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.955508 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.955732 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.955828 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.956050 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.956136 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.956376 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.956471 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.956689 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.956775 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.957008 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.957094 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.957321 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.957421 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.957633 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.957722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.957982 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.958071 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.958298 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.958397 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.958607 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.958693 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.958919 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.959015 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.959231 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.959327 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.959543 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.959638 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.959854 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.959949 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.960169 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.960256 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.960477 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.960563 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.960789 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.960884 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.961101 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.961197 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.961406 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.961521 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.961811 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.961966 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.962137 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.962329 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.962448 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.962767 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.962905 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.963103 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.963243 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.963565 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.963658 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.963890 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.963991 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.964215 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.964305 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.964539 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.964633 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.964876 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.964963 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.965207 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.965303 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.965545 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.965641 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.965890 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.965993 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.966209 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.966314 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.966516 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.966617 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.966828 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.966918 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.967144 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.967232 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.967455 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.967544 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.967759 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.967845 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.968068 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.968157 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.968378 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.968467 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.968683 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.968776 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.968992 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.969080 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.969299 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.969395 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.969608 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.969694 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.969946 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.970046 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.970255 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.970350 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.970571 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.970660 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.970879 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.970974 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.971197 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.971286 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.971507 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.971601 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.971815 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.971919 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.972123 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.972214 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.972431 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.972518 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.972737 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.972901 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.973054 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.973150 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.973404 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.973498 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.973715 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.973865 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.974088 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.974177 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.974395 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.974481 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.974704 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.974794 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.975031 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.975120 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.975339 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.975433 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.975645 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.975734 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.975949 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.976043 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.976263 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.976351 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.976571 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.976658 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.976880 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.976967 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.977217 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.977343 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.977530 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.977618 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.977920 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.978009 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.978235 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.978336 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.978545 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.978640 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.978860 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.978954 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.979166 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.979262 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.979486 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.979573 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.979795 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.979882 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.980098 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.980199 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.980405 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.980505 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.980716 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.980803 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.981027 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.981124 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.981329 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.981422 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.981643 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.981731 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.981976 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.982072 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.982295 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.982399 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.982599 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.982685 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.982906 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.983002 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.983211 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.983299 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.983518 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.983603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.983829 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.983925 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.984132 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.984228 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.984450 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.984543 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.984760 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.984847 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.985068 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.985153 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.985374 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.985470 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.985685 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.985809 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.986019 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.986117 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.986326 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.986426 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.986633 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.986719 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.986944 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.987032 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.987260 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.987361 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.987565 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.987651 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.987878 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.987965 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.988183 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.988271 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.988489 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.988576 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.988795 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.988882 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.989106 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.989202 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.989409 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.989494 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.989714 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.989832 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.990043 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.990134 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.990349 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.990438 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.990654 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.990742 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.990959 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.991046 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.991267 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.991354 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.991571 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.991665 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.991881 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.991970 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.992190 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.992277 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.992498 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.992592 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.993342 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.993439 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.993698 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.993963 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.994065 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.994310 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.994418 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.994636 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.994724 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.994962 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.995058 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.995280 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.995370 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.995598 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.995686 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.995913 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.995999 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.996222 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.996309 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.996532 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.996619 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.996843 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.996946 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.997410 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.997503 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.997717 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.997835 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.998050 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.998150 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.998358 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.998448 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.998677 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.998763 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.998991 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.999087 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.999305 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.999391 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.999628 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.999713 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:15.999954 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.000048 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.000260 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.000355 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.000572 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.000660 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.000886 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.000982 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.001195 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.001288 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.001504 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.001592 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.001840 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.001931 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.002160 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.002248 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.002472 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.002609 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.002773 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.002858 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.003085 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.003174 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.003398 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.003485 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.003709 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.003798 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.004020 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.004107 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.004332 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.004437 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.004638 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.004728 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.004946 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.005032 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.005266 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.005362 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.005575 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.005657 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.005907 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.006008 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.006216 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.006312 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.006526 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.006613 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.006831 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.006918 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.007139 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.007266 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.007579 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.007667 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.007891 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.007978 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.008200 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.008290 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.009078 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.009184 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.009398 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.009590 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.009717 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.009997 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.010129 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.010340 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.010478 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.010639 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.010741 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.011070 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.011166 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.011390 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.011477 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.011705 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.011804 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.012021 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.012115 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.012328 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.012460 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.012636 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.012724 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.012948 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.013041 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.013278 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.013366 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.013585 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.013679 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.013915 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.014005 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.014225 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.014311 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.014551 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.014654 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.014858 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.014946 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.015183 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.015270 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.015608 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.015696 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.015923 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.016018 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.016244 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.016350 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.016650 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.016746 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.016964 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.017051 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.017278 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.017372 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.017607 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.017709 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.017954 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.018049 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.018283 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.018379 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.018591 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.018772 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.018909 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.018999 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.019222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.019316 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.019550 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.019650 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.019879 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.019973 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.020191 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.020278 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.020510 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.020607 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.020817 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.020905 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.021142 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.021232 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.021469 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.021557 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.021809 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.021913 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.022140 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.022227 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.022565 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.022654 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.022895 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.022985 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.023211 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.023304 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.023540 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.023629 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.023871 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.023985 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.024223 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.024351 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.024535 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.024769 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.024864 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.025098 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.025187 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.025419 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.025549 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.025739 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.025881 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.026076 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.026175 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.026390 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.026480 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.026706 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.026794 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.027018 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.027114 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.027325 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.027415 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.027639 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.027728 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.027955 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.028043 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.028261 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.028356 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.028587 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.028682 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.028906 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.029013 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.029230 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.029318 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.029552 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.029647 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.029890 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.029995 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.030213 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.030346 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.030527 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.030613 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.030837 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.030934 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.031143 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.031231 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.031451 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.031539 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.031762 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.031858 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.032096 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.032183 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.032417 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.032504 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.032749 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.032847 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.033079 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.033166 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.033393 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.033482 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.033732 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.033882 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.034085 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.034192 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.034408 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.034522 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.034735 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.034835 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.035058 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.035153 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.035367 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.035454 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.035678 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.035774 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.035994 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.036092 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.036303 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.036406 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.036614 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.036701 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.036920 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.037014 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.037228 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.037329 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.037538 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.037625 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.037871 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.037963 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.038178 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.038277 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.038487 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.038574 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.038801 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.038888 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.039115 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.039211 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.039431 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.039520 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.039768 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.039920 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.040078 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.040226 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.040395 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.040544 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.040661 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.040903 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.041011 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.041220 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.041310 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.041557 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.041645 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.041897 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.042002 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.042230 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.042319 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.042553 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.042649 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.042875 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.043029 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.043196 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.043337 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.043515 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.043647 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.043866 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.044005 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.044143 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.044291 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.044429 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.044566 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.044739 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.044876 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.045062 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.045158 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.045379 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.045467 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.045704 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.045830 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.046251 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.046349 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.046585 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.046681 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.046908 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.047005 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.047223 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.047310 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.047538 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.047638 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.047854 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.047942 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.048171 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.048260 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.048489 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.048589 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.048802 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.048892 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.049118 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.049206 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.049431 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.049530 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.049775 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.049877 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.050096 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.050184 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.050427 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.050517 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.050768 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.050856 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.051090 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.051176 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.051407 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.051494 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.051725 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.051814 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.052043 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.052138 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.052403 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.052496 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.052722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.052858 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.053032 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.053174 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.053353 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.053441 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.053669 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.053787 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.054014 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.054104 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.054330 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.054419 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.054646 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.054733 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.054964 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.055060 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.055802 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.055905 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.056195 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.056291 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.056520 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.056694 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.056846 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.057021 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.057169 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.057342 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.057506 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.057675 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.057878 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.058044 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.058212 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.058381 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.058536 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.058702 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.058860 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.059022 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.059186 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.059341 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.059722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.059869 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.060048 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.060192 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.060391 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.060530 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.060727 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.060863 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.061062 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.061179 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.061386 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.061500 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.061715 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.061847 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.062079 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.062167 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.062395 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.062485 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.062708 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.062804 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.063029 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.063127 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.063347 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.063438 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.063664 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.063754 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.063989 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.064087 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.064305 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.064395 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.064613 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.064703 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.064939 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.065088 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.065252 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.065354 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.065812 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.065911 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.066165 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.066265 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.066486 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.066588 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.066814 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.066900 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.067145 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.067247 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.067470 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.067557 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.067778 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.067864 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.068106 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.068201 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.068416 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.068503 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.068725 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.068813 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.069044 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.069132 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.069360 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.069447 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.069667 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.069785 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.070001 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.070092 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.070318 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.070413 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.070634 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.070720 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.071478 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.071581 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.071893 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.071980 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.072215 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.072360 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.072557 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.072697 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.072875 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.073012 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.073191 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.073326 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.073510 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.073638 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.073857 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.073986 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.074176 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.074300 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.074492 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.074610 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.074809 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.074905 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.075124 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.075290 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.075444 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.075541 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.075758 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.075855 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.076078 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.076175 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.076392 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.076483 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.076710 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.076803 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.077019 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.077108 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.077331 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.077419 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.077640 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.077728 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.077991 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.078082 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.078305 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.078391 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.078653 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.078740 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.078974 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.079064 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.079289 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.079377 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.079618 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.079714 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.079935 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.080026 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.080249 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.080338 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.080602 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.080704 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.080925 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.081014 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.081467 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.081556 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.081834 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.081938 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.082162 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.082259 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.082506 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.082596 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.082845 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.082942 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.083162 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.083250 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.083472 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.083559 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.083784 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.083882 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.084116 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.084204 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.084434 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.084522 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.084754 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.084844 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.085071 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.085160 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.085388 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.085485 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.085706 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.085845 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.086046 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.086141 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.086364 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.086462 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.086719 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.086809 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.087206 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.087319 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.087442 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.087541 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.087760 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.087849 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.088077 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.088165 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.088396 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.088492 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.088709 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.088796 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.089031 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.089128 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.089380 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.089482 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.089706 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.089823 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.090052 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.090148 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.090374 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.090463 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.090695 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.090782 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.091008 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.091103 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.091323 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.091412 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.091637 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.091724 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.091949 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.092036 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.092270 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.092360 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.092603 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.092691 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.092920 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.093015 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.093230 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.093318 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.093656 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.093763 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.093997 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.094096 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.094325 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.094415 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.094652 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.094739 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.094965 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.095061 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.095292 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.095382 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.095620 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.095708 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.095936 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.096034 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.096262 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.096351 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.096580 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.096669 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.096912 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.097000 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.097257 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.097344 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.097589 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.097677 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.097945 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.098036 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.098260 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.098358 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.098569 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.098666 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.098879 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.098966 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.099191 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.099286 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.099516 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.099614 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.099832 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.099920 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.100137 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.100225 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.100444 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.100542 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.100759 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.100848 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.101068 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.101157 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.101372 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.101472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.101680 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.101823 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.102014 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.102136 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.102471 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.102569 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.102697 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.102911 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.103004 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.103085 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.103293 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.103442 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.103600 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.103697 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.103906 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.103995 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.104214 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.104303 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.104526 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.104613 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.104833 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.104922 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.105141 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.105231 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.105444 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.105538 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.105767 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.105919 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.106077 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.106166 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.106416 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.106504 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.106753 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.106849 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.107074 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.107161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.107399 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.107486 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.107717 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.107814 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.108042 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.108129 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.108357 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.108444 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.108680 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.108777 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.109008 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.109098 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.109326 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.109420 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.109642 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.109730 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.110004 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.110093 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.110323 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.110411 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.110641 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.110740 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.110955 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.111051 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.111269 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.111356 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.111583 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.111672 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.111897 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.111985 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.112226 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.112312 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.112557 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.112647 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.112866 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.112955 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.113194 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.113292 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.113517 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.113614 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.113868 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.113959 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.114190 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.114294 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.114507 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.114596 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.114842 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.114929 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.115156 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.115254 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.115471 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.115608 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.115787 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.115876 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.116099 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.116195 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.116414 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.116512 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.116729 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.116863 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.117042 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.117132 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.117355 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.117443 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.117675 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.118288 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.118556 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.118654 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.118869 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.118973 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.119204 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.119307 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.119524 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.119620 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.119859 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.119955 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.120194 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.120296 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.120545 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.120639 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.120864 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.120952 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.121210 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.121306 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.121543 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.121640 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.121891 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.121983 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.122468 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.122558 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.122777 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.122866 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:29:16.123018 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:29:16.123105 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:29:16.276759 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO dbcounter [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Registered counter for database nova_api Aug 24 14:29:16.278599 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO dbcounter [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Registered counter for database nova_api Aug 24 14:29:16.298230 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_db.sqlalchemy.engines [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:29:16.299785 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_db.sqlalchemy.engines [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:29:16.304857 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writer thread running {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:29:16.306850 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writer thread running {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:29:16.381741 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.context [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),394a1067-454b-4b02-98e2-91da0c17a51a(cell1) {{(pid=106210) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:29:16.382489 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.context [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),394a1067-454b-4b02-98e2-91da0c17a51a(cell1) {{(pid=106209) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:29:16.385988 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:29:16.386464 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:29:16.386580 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:29:16.387055 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:29:16.388149 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:29:16.388741 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:29:16.388858 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:29:16.389301 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:29:16.389472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:29:16.389946 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:29:16.391441 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:29:16.392072 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:29:16.393499 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO dbcounter [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Registered counter for database nova_cell0 Aug 24 14:29:16.394147 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO dbcounter [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Registered counter for database nova_cell0 Aug 24 14:29:16.399220 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO dbcounter [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Registered counter for database nova_cell1 Aug 24 14:29:16.399836 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO dbcounter [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Registered counter for database nova_cell1 Aug 24 14:29:16.406885 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_db.sqlalchemy.engines [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:29:16.409045 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_db.sqlalchemy.engines [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:29:16.410736 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_db.sqlalchemy.engines [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:29:16.412986 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_db.sqlalchemy.engines [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:29:16.413827 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writer thread running {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:29:16.418517 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writer thread running {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:29:16.611248 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writer thread running {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:29:16.618081 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writer thread running {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:29:16.622612 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO dbcounter [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Registered counter for database nova_cell0 Aug 24 14:29:16.629739 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO dbcounter [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Registered counter for database nova_cell0 Aug 24 14:29:16.631710 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_db.sqlalchemy.engines [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:29:16.637271 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writer thread running {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:29:16.639271 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG oslo_db.sqlalchemy.engines [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:29:16.643736 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writer thread running {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:29:17.059029 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: WARNING keystonemiddleware.auth_token [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:29:17.066581 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: WARNING keystonemiddleware.auth_token [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:29:17.089908 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: WARNING keystonemiddleware.auth_token [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:29:17.098866 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: WARNING keystonemiddleware.auth_token [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:29:17.422320 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: WARNING keystonemiddleware.auth_token [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:29:17.428638 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: WARNING keystonemiddleware.auth_token [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:29:17.434807 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0e82479c0 pid: 106210 (default app) Aug 24 14:29:17.437889 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:29:17.439576 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002594 Aug 24 14:29:17.440167 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Wed Aug 24 14:29:17 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:29:17.464735 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: WARNING keystonemiddleware.auth_token [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:29:17.471119 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: WARNING keystonemiddleware.auth_token [None req-36047e1f-e13c-45ec-ad04-7edea73d6f78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:29:17.476567 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0e82479c0 pid: 106209 (default app) Aug 24 14:30:39.766037 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:39.767647 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 Aug 24 14:30:39.768058 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:30:39.781131 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_api:SELECT=3 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:39.782228 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_cell0:SELECT=3 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:39.783435 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_cell1:SELECT=3 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:39.784555 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:40.663364 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-6ebb7c2a-3658-4e67-aaf2-25d720613c85 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:40.712939 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-6ebb7c2a-3658-4e67-aaf2-25d720613c85 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.937142 Aug 24 14:30:40.720834 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 24 14:30:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:30:43.105712 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:43.106868 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-1118f6bc-965f-490f-934f-fa8c86f4b3e4 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 14:30:43.118974 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:30:43.572977 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-8847d676-2661-4888-bcb4-fdaa20630cd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "id": "c1"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:43.593547 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:30:43.593547 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: warnings.warn(msg) Aug 24 14:30:43.687562 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-8847d676-2661-4888-bcb4-fdaa20630cd9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.574118 Aug 24 14:30:43.688502 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:30:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:30:43.702044 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=3 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:43.702883 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell0:SELECT=3 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:43.703968 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell1:SELECT=3 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:43.704685 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:30:43.915509 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1dfad44e-2853-4591-8615-49257872a18f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:43.920776 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:30:43.920776 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: warnings.warn(msg) Aug 24 14:30:44.132118 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-1dfad44e-2853-4591-8615-49257872a18f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.434837 Aug 24 14:30:44.136978 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 14:30:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:30:46.487839 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-8847d676-2661-4888-bcb4-fdaa20630cd9 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:46.489062 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-8847d676-2661-4888-bcb4-fdaa20630cd9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Aug 24 14:30:46.489857 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:30:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:30:47.148183 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-fcab2381-2788-499c-a3f7-aa40515fd934 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "swap": 0, "name": "ds512M"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:47.168230 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:30:47.168230 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: warnings.warn(msg) Aug 24 14:30:47.285048 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-fcab2381-2788-499c-a3f7-aa40515fd934 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.788043 Aug 24 14:30:47.285834 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:30:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:30:47.297765 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-828a784e-bae5-4b3c-9fb4-20f7233bc374 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:47.300944 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:30:47.300944 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: warnings.warn(msg) Aug 24 14:30:47.420087 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-828a784e-bae5-4b3c-9fb4-20f7233bc374 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126292 Aug 24 14:30:47.426598 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 14:30:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:30:49.777987 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-fcab2381-2788-499c-a3f7-aa40515fd934 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:49.779024 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-fcab2381-2788-499c-a3f7-aa40515fd934 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 24 14:30:49.779608 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:30:50.177451 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-58f61099-9f8e-4104-ac8c-20843137f98a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:50.238247 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-58f61099-9f8e-4104-ac8c-20843137f98a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452425 Aug 24 14:30:50.238798 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:30:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:30:50.251487 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-b28a7b4a-be8b-4100-876a-a4868476d817 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:50.333189 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-b28a7b4a-be8b-4100-876a-a4868476d817 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085268 Aug 24 14:30:50.333705 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 14:30:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:30:52.726351 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-58f61099-9f8e-4104-ac8c-20843137f98a admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:52.727493 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-58f61099-9f8e-4104-ac8c-20843137f98a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Aug 24 14:30:52.727917 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:30:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:30:53.204948 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-a5c354a7-a233-433e-ad6c-1eccb1dfe5e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:53.296720 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-a5c354a7-a233-433e-ad6c-1eccb1dfe5e4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562570 Aug 24 14:30:53.297549 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:30:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:30:53.311483 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d3e72211-8017-425a-b5ab-8043ad347139 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:53.391622 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d3e72211-8017-425a-b5ab-8043ad347139 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084888 Aug 24 14:30:53.392400 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 14:30:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:30:55.792383 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-a5c354a7-a233-433e-ad6c-1eccb1dfe5e4 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:55.793417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-a5c354a7-a233-433e-ad6c-1eccb1dfe5e4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 24 14:30:55.794166 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:30:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:30:56.218306 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-8e515762-d131-4296-b2d2-e613387b588f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "disk": 20, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:56.301304 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-8e515762-d131-4296-b2d2-e613387b588f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500772 Aug 24 14:30:56.301889 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:30:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:30:56.314979 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-0554d753-156f-45af-9d72-f7b6f71ccf02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:30:56.397252 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-0554d753-156f-45af-9d72-f7b6f71ccf02 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085434 Aug 24 14:30:56.397773 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 14:30:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:30:58.905192 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-8e515762-d131-4296-b2d2-e613387b588f admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:58.906258 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-8e515762-d131-4296-b2d2-e613387b588f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 24 14:30:58.906672 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:30:59.317315 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-ca469274-5e1a-47ad-9bce-9b0f237b7aa6 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:30:59.349442 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-ca469274-5e1a-47ad-9bce-9b0f237b7aa6 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.435771 Aug 24 14:30:59.350122 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 24 14:30:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:31:01.727068 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-8e515762-d131-4296-b2d2-e613387b588f admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:01.728636 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-8e515762-d131-4296-b2d2-e613387b588f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Aug 24 14:31:01.729410 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:31:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:02.176142 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-2c271db9-588a-4d1d-85cb-eb387f6d535a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:02.256351 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-2c271db9-588a-4d1d-85cb-eb387f6d535a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518453 Aug 24 14:31:02.256939 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:31:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:31:02.271448 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c36579e4-3e6b-49d2-8fdb-0ecadf5d5515 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:02.345189 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c36579e4-3e6b-49d2-8fdb-0ecadf5d5515 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077444 Aug 24 14:31:02.345698 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 14:31:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:31:04.702042 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-2c271db9-588a-4d1d-85cb-eb387f6d535a admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:04.703253 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-2c271db9-588a-4d1d-85cb-eb387f6d535a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001902 Aug 24 14:31:04.703713 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:31:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:05.152523 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-777a48f4-79c1-4f07-94a2-f70e54c6bc29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:05.238176 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-777a48f4-79c1-4f07-94a2-f70e54c6bc29 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.523677 Aug 24 14:31:05.238745 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:31:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:31:05.252225 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-fab307a3-b843-443b-804b-ff33391c1efb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:05.374044 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-fab307a3-b843-443b-804b-ff33391c1efb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125906 Aug 24 14:31:05.374664 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 14:31:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:31:07.798751 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-777a48f4-79c1-4f07-94a2-f70e54c6bc29 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:07.800388 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-777a48f4-79c1-4f07-94a2-f70e54c6bc29 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Aug 24 14:31:07.801028 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:08.254535 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-f573d2c7-2130-4461-8041-89b1b5e80488 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "id": "3", "disk": 40, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:08.330940 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-f573d2c7-2130-4461-8041-89b1b5e80488 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.522831 Aug 24 14:31:08.331782 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:31:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:31:08.344620 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-2d024bf7-f691-4812-a442-dd3dec1dc3a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:08.453521 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-2d024bf7-f691-4812-a442-dd3dec1dc3a2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112535 Aug 24 14:31:08.458244 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 14:31:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:31:10.948190 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-f573d2c7-2130-4461-8041-89b1b5e80488 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:10.949426 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-f573d2c7-2130-4461-8041-89b1b5e80488 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Aug 24 14:31:10.949917 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:31:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:11.407078 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-2d6e2ea9-07d1-4a87-b473-4d801f7e88b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "id": "4"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:11.414423 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:11.513890 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-2d6e2ea9-07d1-4a87-b473-4d801f7e88b4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.557806 Aug 24 14:31:11.514716 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:31:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:31:11.527806 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-bb0d1619-3e5a-4616-89bb-fa174c261fc9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:11.613692 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-bb0d1619-3e5a-4616-89bb-fa174c261fc9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089740 Aug 24 14:31:11.614797 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 14:31:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:31:14.012302 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-2d6e2ea9-07d1-4a87-b473-4d801f7e88b4 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:14.013335 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-2d6e2ea9-07d1-4a87-b473-4d801f7e88b4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 24 14:31:14.013764 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:14.465446 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-42d28898-60f3-48cb-a09d-b6b91eef7029 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "swap": 0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:14.563952 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-42d28898-60f3-48cb-a09d-b6b91eef7029 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.544042 Aug 24 14:31:14.564522 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 14:31:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 14:31:14.577588 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-555ad69e-fbc3-4b0c-b98a-6bc2f500803e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:14.670544 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-555ad69e-fbc3-4b0c-b98a-6bc2f500803e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097361 Aug 24 14:31:14.671380 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 14:31:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:31:33.782330 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-42d28898-60f3-48cb-a09d-b6b91eef7029 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:33.783331 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-42d28898-60f3-48cb-a09d-b6b91eef7029 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 24 14:31:33.783748 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:31:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:34.171734 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-1a98c0ba-731a-4f26-9c67-7a46ce6c1fae admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:34.192071 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-1a98c0ba-731a-4f26-9c67-7a46ce6c1fae admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401475 Aug 24 14:31:34.193361 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 24 14:31:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:31:35.253415 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-42d28898-60f3-48cb-a09d-b6b91eef7029 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:35.254512 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-42d28898-60f3-48cb-a09d-b6b91eef7029 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 24 14:31:35.254917 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:35.775377 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-3ef85e0e-b21d-413a-bc22-d499d280a2a9 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:35.781160 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.wsgi [None req-3ef85e0e-b21d-413a-bc22-d499d280a2a9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-3ef85e0e-b21d-413a-bc22-d499d280a2a9 admin admin] Request method failure captured: Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Accept: application/json Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Accept-Encoding: gzip, deflate Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Connection: keep-alive Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Content-Length: 0 Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Host: 10.222.0.65 Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Openstack-Api-Version: compute 2.90 Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Openstack-System-Scope: None Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: User-Agent: python-novaclient Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Auth-Token: gAAAAABjBjZHfV6oAXuGzNtAkPTwZTlKGeFlT2d_JSsUhKzSELFlxjZrqvb9Rc3J5AK8-b_7oLGT4faRNBtSymIE83pCNS3TN8PZwCnIF6bXtzROpZ7r-7xKjooMYrklp236j_IE1ehYNrkk85zr9BPMSjAfSKj2wksgHfE0mlp1GY2yBapcwcc Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Domain-Id: None Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Domain-Name: None Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Identity-Status: Confirmed Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Is-Admin-Project: True Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Domain-Id: default Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Domain-Name: Default Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Name: admin Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Role: admin,reader,member Aug 24 14:31:35.784472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Roles: admin,reader,member Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}] Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant: admin Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant-Name: admin Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User: admin Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Domain-Id: default Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Domain-Name: Default Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Id: 438e8adacb8940c696f3738e6ff13c30 Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Name: admin Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: method: > Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: exception: Flavor 42 could not be found. Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: action_args: {'id': '42'} Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:31:35.786171 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:35.788224 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.789722 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-3ef85e0e-b21d-413a-bc22-d499d280a2a9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:31:35.791096 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-3ef85e0e-b21d-413a-bc22-d499d280a2a9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388426 Aug 24 14:31:35.791096 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 24 14:31:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:35.796310 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-d8046c36-0550-4f9c-b6c3-714eda560b86 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:35.800661 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:31:35.825674 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-d8046c36-0550-4f9c-b6c3-714eda560b86 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033004 Aug 24 14:31:35.826246 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 14:31:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:31:35.836703 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-5b667786-8b52-4271-9bbb-462d4665fa41 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:35.867647 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-5b667786-8b52-4271-9bbb-462d4665fa41 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035110 Aug 24 14:31:35.868141 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 14:31:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:31:35.883876 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-32964005-688e-4ed1-b505-1b8baff2af52 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:35.890599 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.wsgi [None req-32964005-688e-4ed1-b505-1b8baff2af52 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-32964005-688e-4ed1-b505-1b8baff2af52 admin admin] Request method failure captured: Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Accept: application/json Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Accept-Encoding: gzip, deflate Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Connection: keep-alive Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Content-Length: 0 Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Host: 10.222.0.65 Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Openstack-Api-Version: compute 2.90 Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Openstack-System-Scope: None Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: User-Agent: python-novaclient Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Auth-Token: gAAAAABjBjZHfV6oAXuGzNtAkPTwZTlKGeFlT2d_JSsUhKzSELFlxjZrqvb9Rc3J5AK8-b_7oLGT4faRNBtSymIE83pCNS3TN8PZwCnIF6bXtzROpZ7r-7xKjooMYrklp236j_IE1ehYNrkk85zr9BPMSjAfSKj2wksgHfE0mlp1GY2yBapcwcc Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Domain-Id: None Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Domain-Name: None Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Identity-Status: Confirmed Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Is-Admin-Project: True Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Domain-Id: default Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Domain-Name: Default Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Name: admin Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Role: admin,reader,member Aug 24 14:31:35.893937 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Roles: admin,reader,member Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}] Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant: admin Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant-Name: admin Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User: admin Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Domain-Id: default Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Domain-Name: Default Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Id: 438e8adacb8940c696f3738e6ff13c30 Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Name: admin Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: method: > Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: exception: Flavor 42 could not be found. Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: action_args: {'id': '42'} Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:31:35.899520 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:35.900338 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:35.901371 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-32964005-688e-4ed1-b505-1b8baff2af52 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:31:35.902457 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-32964005-688e-4ed1-b505-1b8baff2af52 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015880 Aug 24 14:31:35.902457 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 24 14:31:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:36.876505 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-5b667786-8b52-4271-9bbb-462d4665fa41 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:36.877616 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-5b667786-8b52-4271-9bbb-462d4665fa41 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 24 14:31:36.878067 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:37.410515 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1c197d19-e0ae-4209-b0a6-dec23ca3429d admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:37.416060 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.wsgi [None req-1c197d19-e0ae-4209-b0a6-dec23ca3429d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1c197d19-e0ae-4209-b0a6-dec23ca3429d admin admin] Request method failure captured: Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Accept: application/json Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Accept-Encoding: gzip, deflate Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Connection: keep-alive Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Content-Length: 0 Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Host: 10.222.0.65 Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Openstack-Api-Version: compute 2.90 Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Openstack-System-Scope: None Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: User-Agent: python-novaclient Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Auth-Token: gAAAAABjBjZIp-td9FoQzyvTiKxm9JMIr4dSKcsCepdp4U6qtxDwfNbmvtLXyweQ2yb0iy6B4qBNf78hg06vHZpnNJeSMx-e1281o1LBYGhTkoxhtjUlp8Y606-5UD-dmqgHVVNXiGlsC8Vvf1lhtZ6bsInp64jEgWNekn34QQwbMAHzrp2GNWo Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Domain-Id: None Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Domain-Name: None Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Identity-Status: Confirmed Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Is-Admin-Project: True Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Domain-Id: default Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Domain-Name: Default Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Name: admin Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Role: admin,reader,member Aug 24 14:31:37.417603 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Roles: admin,reader,member Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}] Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant: admin Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant-Name: admin Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User: admin Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Domain-Id: default Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Domain-Name: Default Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Id: 438e8adacb8940c696f3738e6ff13c30 Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Name: admin Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: method: > Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: exception: Flavor 84 could not be found. Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: action_args: {'id': '84'} Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:31:37.419521 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:37.420757 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.422117 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1c197d19-e0ae-4209-b0a6-dec23ca3429d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:31:37.423413 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-1c197d19-e0ae-4209-b0a6-dec23ca3429d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.400639 Aug 24 14:31:37.423413 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 24 14:31:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:37.429571 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d6416aca-f87a-4103-890b-849bc693374b admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:37.446416 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d6416aca-f87a-4103-890b-849bc693374b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021289 Aug 24 14:31:37.446947 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 14:31:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:31:37.456638 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-5ea6098d-3559-4de2-ae53-d71c9dba4f8b admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:37.473118 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-5ea6098d-3559-4de2-ae53-d71c9dba4f8b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020192 Aug 24 14:31:37.473690 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 14:31:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:31:37.483248 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-b20c104e-d581-42aa-9dfc-69ef62c17e35 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:37.488687 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.wsgi [None req-b20c104e-d581-42aa-9dfc-69ef62c17e35 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-b20c104e-d581-42aa-9dfc-69ef62c17e35 admin admin] Request method failure captured: Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Accept: application/json Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Accept-Encoding: gzip, deflate Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Connection: keep-alive Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Content-Length: 0 Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Host: 10.222.0.65 Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Openstack-Api-Version: compute 2.90 Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Openstack-System-Scope: None Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: User-Agent: python-novaclient Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Auth-Token: gAAAAABjBjZIp-td9FoQzyvTiKxm9JMIr4dSKcsCepdp4U6qtxDwfNbmvtLXyweQ2yb0iy6B4qBNf78hg06vHZpnNJeSMx-e1281o1LBYGhTkoxhtjUlp8Y606-5UD-dmqgHVVNXiGlsC8Vvf1lhtZ6bsInp64jEgWNekn34QQwbMAHzrp2GNWo Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Domain-Id: None Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Domain-Name: None Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Identity-Status: Confirmed Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Is-Admin-Project: True Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Domain-Id: default Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Domain-Name: Default Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Name: admin Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Role: admin,reader,member Aug 24 14:31:37.490826 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Roles: admin,reader,member Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}] Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant: admin Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant-Name: admin Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User: admin Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Domain-Id: default Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Domain-Name: Default Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Id: 438e8adacb8940c696f3738e6ff13c30 Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Name: admin Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: method: > Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: exception: Flavor 84 could not be found. Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: action_args: {'id': '84'} Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:31:37.492509 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:37.493472 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:37.495095 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-b20c104e-d581-42aa-9dfc-69ef62c17e35 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:31:37.496324 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-b20c104e-d581-42aa-9dfc-69ef62c17e35 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012591 Aug 24 14:31:37.496324 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 24 14:31:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:38.455041 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-5ea6098d-3559-4de2-ae53-d71c9dba4f8b admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:38.456073 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-5ea6098d-3559-4de2-ae53-d71c9dba4f8b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 24 14:31:38.456482 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:31:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:38.972533 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-a008de19-1844-4f1d-b029-d7db9a41ef61 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:38.979063 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.wsgi [None req-a008de19-1844-4f1d-b029-d7db9a41ef61 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-a008de19-1844-4f1d-b029-d7db9a41ef61 admin admin] Request method failure captured: Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Accept: application/json Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Accept-Encoding: gzip, deflate Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Connection: keep-alive Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Content-Length: 0 Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Host: 10.222.0.65 Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Openstack-Api-Version: compute 2.90 Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Openstack-System-Scope: None Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: User-Agent: python-novaclient Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Auth-Token: gAAAAABjBjZKrUA1_R1BJZlEe61CWkv4aIA-OtSHGSFHj-e-Qp4YbEPKOAgG_qVInid_DqYlgl1GCUFIwa9ZibdDvHZ9KwM_CglviPNKJ8ns_iOFF_RQjak5xDJ_Nb4F1QjtcYmi0u1aH5vwcaYaA8UrKWcvHmMqDeOwYmTj0rnnSvFL6CHjwu0 Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Domain-Id: None Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Domain-Name: None Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Identity-Status: Confirmed Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Is-Admin-Project: True Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Domain-Id: default Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Domain-Name: Default Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Project-Name: admin Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Role: admin,reader,member Aug 24 14:31:38.980594 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Roles: admin,reader,member Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}] Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant: admin Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-Tenant-Name: admin Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User: admin Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Domain-Id: default Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Domain-Name: Default Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Id: 438e8adacb8940c696f3738e6ff13c30 Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: X-User-Name: admin Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: method: > Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: exception: Flavor 451 could not be found. Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: action_args: {'id': '451'} Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:31:38.982222 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:38.984344 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 24 14:31:38.985497 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-a008de19-1844-4f1d-b029-d7db9a41ef61 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:31:38.986547 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-a008de19-1844-4f1d-b029-d7db9a41ef61 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387318 Aug 24 14:31:38.986547 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 14:31:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:38.992506 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-63ec4cbb-1e60-4257-90a1-9ec03db64c53 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:39.009360 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-63ec4cbb-1e60-4257-90a1-9ec03db64c53 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021051 Aug 24 14:31:39.009914 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 14:31:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:31:39.019329 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:39.036518 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020714 Aug 24 14:31:39.037716 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 14:31:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:31:39.047259 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-4ad58212-d8da-481f-bd76-30b045d4e829 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:39.052811 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.wsgi [None req-4ad58212-d8da-481f-bd76-30b045d4e829 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-4ad58212-d8da-481f-bd76-30b045d4e829 admin admin] Request method failure captured: Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Accept: application/json Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Accept-Encoding: gzip, deflate Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Connection: keep-alive Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Content-Length: 0 Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Host: 10.222.0.65 Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Openstack-Api-Version: compute 2.90 Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Openstack-System-Scope: None Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: User-Agent: python-novaclient Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Auth-Token: gAAAAABjBjZKrUA1_R1BJZlEe61CWkv4aIA-OtSHGSFHj-e-Qp4YbEPKOAgG_qVInid_DqYlgl1GCUFIwa9ZibdDvHZ9KwM_CglviPNKJ8ns_iOFF_RQjak5xDJ_Nb4F1QjtcYmi0u1aH5vwcaYaA8UrKWcvHmMqDeOwYmTj0rnnSvFL6CHjwu0 Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Domain-Id: None Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Domain-Name: None Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Identity-Status: Confirmed Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Is-Admin-Project: True Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Domain-Id: default Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Domain-Name: Default Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Project-Name: admin Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Role: admin,reader,member Aug 24 14:31:39.054417 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Roles: admin,reader,member Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f4410563d8b45fea6a29fd68277b77c"}]}] Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant: admin Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant-Id: 4f4410563d8b45fea6a29fd68277b77c Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-Tenant-Name: admin Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User: admin Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Domain-Id: default Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Domain-Name: Default Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Id: 438e8adacb8940c696f3738e6ff13c30 Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: X-User-Name: admin Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: method: > Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: exception: Flavor 451 could not be found. Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: action_args: {'id': '451'} Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:31:39.056095 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:39.056927 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 24 14:31:39.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-4ad58212-d8da-481f-bd76-30b045d4e829 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:31:39.059400 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-4ad58212-d8da-481f-bd76-30b045d4e829 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012318 Aug 24 14:31:39.059400 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 14:31:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 14:31:40.024648 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:40.025739 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Aug 24 14:31:40.026172 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:40.557792 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-a877d88e-2574-4d5b-a3fd-01efe07d3f6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:40.649062 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-a877d88e-2574-4d5b-a3fd-01efe07d3f6a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.480991 Aug 24 14:31:40.649632 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 24 14:31:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:31:41.615591 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:41.616651 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 24 14:31:41.617060 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:31:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:42.141025 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-5524feb6-1daa-419b-89b3-2e4bf16a66e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:42.213907 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-5524feb6-1daa-419b-89b3-2e4bf16a66e3 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.452240 Aug 24 14:31:42.214475 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 24 14:31:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:31:43.189356 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:43.190414 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 24 14:31:43.190816 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:31:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:43.715595 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-232cd0dd-9ca2-4c07-a3d4-9f32ff258e00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:43.785391 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-232cd0dd-9ca2-4c07-a3d4-9f32ff258e00 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.453977 Aug 24 14:31:43.785968 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 24 14:31:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:31:44.761797 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:44.762823 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 24 14:31:44.763254 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:31:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:45.285867 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-d3f3c544-3d0a-483a-8325-292f90d8be52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:31:45.357415 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-d3f3c544-3d0a-483a-8325-292f90d8be52 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.453562 Aug 24 14:31:45.358006 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 24 14:31:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:31:46.323424 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:46.324439 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 24 14:31:46.324836 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:31:46.850639 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-d772ae2d-a1da-4cc3-a398-a2713db8b206 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:31:46.873489 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-d772ae2d-a1da-4cc3-a398-a2713db8b206 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406522 Aug 24 14:31:46.874063 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Wed Aug 24 14:31:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:32:40.338481 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:40.339657 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c90ceec4-6123-48b6-a34c-e63f9d10b6e3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Aug 24 14:32:40.339977 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 14:32:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:32:40.351753 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:40.732773 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e8764323-ea17-4820-bdfc-140f2369ea7e admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:40.756109 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e8764323-ea17-4820-bdfc-140f2369ea7e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409772 Aug 24 14:32:40.756589 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 24 14:32:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:32:40.778191 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:32:40.781989 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-355b0d1f-2f5f-4775-9bbc-3705d176dcac admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:40.795256 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-355b0d1f-2f5f-4775-9bbc-3705d176dcac admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013303 Aug 24 14:32:40.795256 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 24 14:32:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:32:40.802004 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-4ab875df-d1e7-4f8c-a5ab-15777c628179 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:40.810142 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-4ab875df-d1e7-4f8c-a5ab-15777c628179 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011779 Aug 24 14:32:40.810674 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 24 14:32:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:32:40.822778 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:40.831517 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011787 Aug 24 14:32:40.832050 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 24 14:32:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:32:40.843452 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-90fe926d-b601-4025-9b74-4b19a7173f7d admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:32:40.851384 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-90fe926d-b601-4025-9b74-4b19a7173f7d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011594 Aug 24 14:32:40.851916 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 24 14:32:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:54.773824 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:54.774859 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Aug 24 14:35:54.775269 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:54.917032 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=6 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:55.075751 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-fee15540-7f66-4446-bcc7-e32e55a99f7f admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:55.078140 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:35:55.078140 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: warnings.warn(msg) Aug 24 14:35:55.079268 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-fee15540-7f66-4446-bcc7-e32e55a99f7f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:55.079741 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-fee15540-7f66-4446-bcc7-e32e55a99f7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:55.080169 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-fee15540-7f66-4446-bcc7-e32e55a99f7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:55.080918 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-fee15540-7f66-4446-bcc7-e32e55a99f7f admin admin] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:55.081368 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-fee15540-7f66-4446-bcc7-e32e55a99f7f admin admin] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:55.081809 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-fee15540-7f66-4446-bcc7-e32e55a99f7f admin admin] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:55.121030 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-fee15540-7f66-4446-bcc7-e32e55a99f7f admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205543 Aug 24 14:35:55.121658 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 14:35:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:35:55.946809 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:55.947834 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 14:35:55.948235 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:35:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:35:56.138459 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e9a4b41e-2fa0-4654-a0af-b2feb295a158 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:35:56.140852 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:35:56.140852 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: warnings.warn(msg) Aug 24 14:35:56.142031 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e9a4b41e-2fa0-4654-a0af-b2feb295a158 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:56.142505 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e9a4b41e-2fa0-4654-a0af-b2feb295a158 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:56.142933 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e9a4b41e-2fa0-4654-a0af-b2feb295a158 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:56.143636 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e9a4b41e-2fa0-4654-a0af-b2feb295a158 admin admin] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:35:56.144740 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e9a4b41e-2fa0-4654-a0af-b2feb295a158 admin admin] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:35:56.145454 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e9a4b41e-2fa0-4654-a0af-b2feb295a158 admin admin] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:35:56.165932 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e9a4b41e-2fa0-4654-a0af-b2feb295a158 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078691 Aug 24 14:35:56.166421 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 14:35:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:36:07.409985 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:07.411012 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 24 14:36:07.411449 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:36:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:07.556334 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell0:SELECT=4 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.557082 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell1:SELECT=4 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.557698 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=8 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.605587 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-ac39999f-c931-4cc0-a918-ad6ff5e0e868 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:07.608336 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:36:07.608336 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: warnings.warn(msg) Aug 24 14:36:07.611427 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-ac39999f-c931-4cc0-a918-ad6ff5e0e868 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:07.611427 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-ac39999f-c931-4cc0-a918-ad6ff5e0e868 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:07.611427 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-ac39999f-c931-4cc0-a918-ad6ff5e0e868 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:07.611427 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-ac39999f-c931-4cc0-a918-ad6ff5e0e868 admin admin] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:07.611773 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-ac39999f-c931-4cc0-a918-ad6ff5e0e868 admin admin] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:07.612005 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-ac39999f-c931-4cc0-a918-ad6ff5e0e868 admin admin] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:07.638703 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-ac39999f-c931-4cc0-a918-ad6ff5e0e868 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087239 Aug 24 14:36:07.639272 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 14:36:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:36:08.468799 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:08.469862 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-cdd1e5c4-c6cb-4e30-aed2-71f8b94f96b3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 24 14:36:08.470273 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 14:36:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:36:08.663949 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-7ca2c9ed-60e6-4c77-8977-9416a8a2d912 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:36:08.666382 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:36:08.666382 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: warnings.warn(msg) Aug 24 14:36:08.667483 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-7ca2c9ed-60e6-4c77-8977-9416a8a2d912 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:08.667961 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-7ca2c9ed-60e6-4c77-8977-9416a8a2d912 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:08.668395 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-7ca2c9ed-60e6-4c77-8977-9416a8a2d912 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:08.669107 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-7ca2c9ed-60e6-4c77-8977-9416a8a2d912 admin admin] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:36:08.669567 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-7ca2c9ed-60e6-4c77-8977-9416a8a2d912 admin admin] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:36:08.670006 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-7ca2c9ed-60e6-4c77-8977-9416a8a2d912 admin admin] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:36:08.693137 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-7ca2c9ed-60e6-4c77-8977-9416a8a2d912 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082899 Aug 24 14:36:08.693693 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 14:36:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:37:06.311044 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: Wed Aug 24 14:37:06 2022 - graceful shutdown triggered... Aug 24 14:37:06.311686 dv-cinder-756710-6-iscsi devstack@n-api.service[106209]: Gracefully killing worker 1 (pid: 106209)... Aug 24 14:37:06.311092 dv-cinder-756710-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 14:37:06.314721 dv-cinder-756710-6-iscsi devstack@n-api.service[106210]: Gracefully killing worker 2 (pid: 106210)... Aug 24 14:37:07.312195 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: worker 1 buried after 1 seconds Aug 24 14:37:07.312684 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: worker 2 buried after 1 seconds Aug 24 14:37:07.312684 dv-cinder-756710-6-iscsi devstack@n-api.service[106208]: goodbye to uWSGI. Aug 24 14:37:07.313774 dv-cinder-756710-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 14:37:07.314336 dv-cinder-756710-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 14:37:07.317148 dv-cinder-756710-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 14:37:07.326583 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 14:37:07 2022] *** Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: nodename: dv-cinder-756710-6-iscsi Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: machine: x86_64 Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: clock source: unix Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: pcre jit disabled Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: detected number of CPU cores: 4 Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: current working directory: / Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: detected binary path: /usr/bin/uwsgi-core Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: your processes number limit is 47680 Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: your memory page size is 4096 bytes Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: detected max file descriptor number: 2048 Aug 24 14:37:07.328590 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: lock engine: pthread robust mutexes Aug 24 14:37:07.329687 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: thunder lock: enabled Aug 24 14:37:07.329687 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 14:37:07.329687 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 14:37:07.370377 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: Python main interpreter initialized at 0x563e041709c0 Aug 24 14:37:07.370377 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: python threads support enabled Aug 24 14:37:07.370377 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: your server socket listen backlog is limited to 100 connections Aug 24 14:37:07.370377 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: your mercy for graceful operations on workers is 90 seconds Aug 24 14:37:07.370947 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 14:37:07.370947 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: *** Operational MODE: preforking *** Aug 24 14:37:07.371173 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: *** uWSGI is running in multiple interpreter mode *** Aug 24 14:37:07.371173 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: spawned uWSGI master process (pid: 132877) Aug 24 14:37:07.371615 dv-cinder-756710-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 14:37:07.372939 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: spawned uWSGI worker 1 (pid: 132890, cores: 1) Aug 24 14:37:07.372939 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: spawned uWSGI worker 2 (pid: 132892, cores: 1) Aug 24 14:37:07.372939 dv-cinder-756710-6-iscsi devstack@n-api.service[132877]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 14:37:08.057544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:37:08.059043 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 14:37:09.227068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:37:09.227068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: from cryptography.utils import int_from_bytes Aug 24 14:37:09.227783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:37:09.227783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: from cryptography.utils import int_from_bytes Aug 24 14:37:09.227976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:37:09.227976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: from cryptography.utils import int_from_bytes Aug 24 14:37:09.228368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:37:09.228368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: from cryptography.utils import int_from_bytes Aug 24 14:37:11.680901 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:37:11.681598 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:37:11.681698 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:37:11.682093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:37:11.682185 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:37:11.682271 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:37:11.682380 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:37:11.682454 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:37:11.682780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.682892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:37:11.682977 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.683060 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:37:11.683302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.683489 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.683740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.684155 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.684339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.684495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.684692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.684952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.685062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.685273 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.685394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.685602 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.685715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.685952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.686058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.686223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.686380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.686538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.686693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.686889 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.687068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756710-6-iscsi {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.687231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.687386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756710-6-iscsi {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.687543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.687691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.687850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.688008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.688172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.688342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.688504 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.688658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.688832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.689021 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.689226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.689380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.689380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.689678 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.690735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.690735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.691247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.691464 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.691681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.691918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.692144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.692367 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.692593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.692818 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.693048 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.693340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.694306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.694559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.694784 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.695016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.695252 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.695734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.697383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.697854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.698031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.698962 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756710-6-iscsi {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.699138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756710-6-iscsi {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.699301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.699466 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.699656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.699811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.699960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.700154 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.700316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.700485 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.701161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.701331 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.701491 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.701652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.701857 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.702120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.702421 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.703192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.703364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.703522 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.703686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.703850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.704006 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.704287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.704444 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.704612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.705299 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.712106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.712688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.713108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.713196 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.713302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.713387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.713462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.713566 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.713644 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.713726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.714551 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.714645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.714728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.714808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.714882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.714972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715048 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715198 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715278 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715617 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.715930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716524 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716606 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.716983 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717228 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717309 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717470 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717626 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717734 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.717964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.718063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.718730 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.718909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.719063 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.719211 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.719362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.719506 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.719680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.719836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.720020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.720166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.720322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.720473 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.720629 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.720786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.720929 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.721074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.721220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.721363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.721524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.721675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.721847 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.721988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.722132 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.722323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.722494 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.722644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.722793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.722936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.723078 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.723222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.723389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.723536 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.725881 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.726094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.726287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.726447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.726616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.726792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.726966 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.727133 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.727317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.727474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.727629 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.727779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.727932 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.728074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.728217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.728371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.728515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.728666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.728826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.728978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.729133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.729285 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.729449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.729639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.729735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.730005 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.730146 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.730299 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.730451 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.730592 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.733868 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.734821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.734944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735518 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735886 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.735974 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.736386 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.736499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.736590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.736688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.736777 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.736875 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.736978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.737067 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.737162 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.737250 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.737348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.737486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.737622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.737768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.739654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.739842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.740019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.740218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.740394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.740555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742046 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742186 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742494 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742590 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742707 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.742901 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743002 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743090 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743544 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743732 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743825 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743911 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.743995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744732 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.744922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.745009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.745109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.745205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.745291 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.745388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.745501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.745598 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:37:11.745700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.745824 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.745910 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.745994 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746242 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746315 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746395 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746652 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.746815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747133 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747230 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747426 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747525 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747620 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.747982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748269 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748663 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748863 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.748943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749202 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749849 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.749947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.750800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751070 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751354 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751440 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751629 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.751995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.753882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.754537 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.754728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.754881 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.755029 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.755172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.755314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.755448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.755603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.755832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.756045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.756238 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.757782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.757942 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758077 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758380 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758480 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.758964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759775 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759861 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.759947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760126 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760411 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760507 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760595 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760857 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.760945 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761189 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761274 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761650 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761730 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761840 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.761986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762262 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762629 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.762914 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763102 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763479 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763753 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.763941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764569 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.764951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.765089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.765229 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.765369 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.765510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.765642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.769520 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.769734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.769861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.769947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770212 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770462 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770634 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770822 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770908 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.770981 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.771062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.771141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.771222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.771851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772139 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.773455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.773455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.773455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.773455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.773455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.773455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.773455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.773455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.774142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.774142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.774142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.774446 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.774585 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.774701 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.774888 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.775041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.775196 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.775332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.775474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.775609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.775741 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.775916 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.776059 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.776207 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.776340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.776480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.776623 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.776756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.776942 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.777090 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.777225 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.777357 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.777497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.777497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.777770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778367 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.778905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779097 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779251 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779519 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779743 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779833 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.779958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.780095 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.780194 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.780282 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.780424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.780515 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.780659 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.780795 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.780915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781592 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781817 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.781922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782017 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782580 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782762 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.782953 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783220 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783313 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783565 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783662 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783855 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.783943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784028 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784211 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784296 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784671 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.784939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785360 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785463 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785739 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785862 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.785862 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.786031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.786117 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.786203 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.786288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.786387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.786483 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.786571 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.786689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.788927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.789073 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.789201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.789324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.789448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.789571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.789695 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.792522 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.792679 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.792821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.792974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.792974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.793278 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.793454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.793635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.793831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.793990 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.794143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.794290 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.794448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.794584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.794684 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.794772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.794772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.794947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795129 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795216 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795784 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795876 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.795964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796059 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796450 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796545 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796640 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796828 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.796921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797541 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.797947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798216 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798407 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798679 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.798960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799048 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799228 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799561 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799698 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.799894 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800504 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800652 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800746 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800840 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.800928 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801062 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801430 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801564 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.801968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.802059 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.802145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.802239 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.802326 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.802425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.802513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.802513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.802762 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803266 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803628 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803730 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803819 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.803913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804005 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804179 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804598 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804897 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.804984 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805078 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805179 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805526 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805786 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.805981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806209 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806406 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806761 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806847 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.806947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.807035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.807127 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.807214 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.807300 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.807395 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.807490 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.807577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.807830 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.808175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.808332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.808532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.808658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.808787 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.808909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.809038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.809152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.809276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.809392 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.809505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.809633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.809773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.809893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810402 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810758 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810870 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.810991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.811114 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.811237 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.811385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.811527 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.811669 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.811810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.811944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.812076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.812220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.812363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.812504 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.812638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.812770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.812902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.813047 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.813182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.813317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.813449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.813592 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.813734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.813923 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.814057 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.814201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.814378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.814503 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.814709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.814827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.814942 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815064 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815186 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815307 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815432 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815814 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.815942 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.816047 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.816136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.816230 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.816325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.816413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.816563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.816716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.816869 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.817022 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.817168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.817327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.817482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.817633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.817800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.821119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.821251 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.821396 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.821504 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.821594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.821692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.821810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.821949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822194 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822472 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822743 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.822924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823012 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823498 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823498 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823655 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823754 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823856 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.823945 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824418 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824825 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.824928 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825026 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.825926 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826214 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826477 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826699 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.826982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827122 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827522 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827713 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827809 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.827905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.828074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.828217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.828310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.828415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.828583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.828693 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.828894 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.828992 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.829201 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.829297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.829511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.829609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.829847 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.829961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.830150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.830262 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.830468 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.830635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.830773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.830869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.831078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.831174 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.831387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.831554 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.831685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.831828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.831997 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.832103 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.832304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.832410 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.832641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.832735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.832960 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.833063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.833279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.833384 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.833600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.833702 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.835122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.835447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.835555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.835659 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.835749 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.835895 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.835988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836176 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836306 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836409 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836594 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836886 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.836975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.837069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.837196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.837340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.837496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.837646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.837821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.837984 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.838175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.838363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.838469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.838603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.838774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.838908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.839096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.839206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.839411 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.839528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.839713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.839817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.840020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.840130 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.840321 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.840563 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.840664 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.840829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.840927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.841135 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.841328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.841550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.841661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.841955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.842070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.842260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.842355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.842569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.842676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.842876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.843054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.843187 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.843289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.843489 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.843608 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.843790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.843893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.844102 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.844196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.844429 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.844532 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.844758 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.844876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.845074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.845180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.845378 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.845479 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.845681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.848696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.848835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.848939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.849028 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.849116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.849216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.849312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.849408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.850201 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.850309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.850406 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.850509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.850742 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.850874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.850978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851349 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851524 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851620 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.851964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852269 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852621 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852805 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.852986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.853081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.853179 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.853268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.853361 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.853456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.853591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.853717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.853885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854105 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854202 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854338 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854525 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.854892 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.855020 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.855111 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.855212 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.855301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.855457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.855705 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.855801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.856026 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.856123 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.856333 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.856428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.856646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.856747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.856969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.857071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.857274 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.857373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.857576 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.857680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.857921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.858027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.858228 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.858373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.858533 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.858636 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.858855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.858997 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.859159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.859263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.859474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.859579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.859783 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.859887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.860089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.860184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.860390 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.860499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.860712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.860847 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.861006 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.861101 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.861582 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.861705 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.861912 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.862011 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.862220 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.862316 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.862529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.862638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.862835 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.862933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.863141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.863280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.863445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.863571 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.863768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.863872 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.864067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.864168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.864373 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.864505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.864677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.864807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.865015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.865166 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.865389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.865547 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.865774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.865873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.866126 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.866222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.866456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.866564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.866811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.866955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.867166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.867309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.867436 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.867553 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.867755 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.867880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.868070 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.868205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.868385 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.868512 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.868774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.868880 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.868980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.869109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.869264 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.869368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.869568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.869663 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.869893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.870040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.870195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.870291 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.870501 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.870605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.870803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.871126 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.871243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.871391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.871489 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.871708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.871810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.872009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.872113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.872328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.872430 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.872632 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.872736 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.872933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.873031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.873236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.873379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.873534 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.873639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.873894 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.878577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.878724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.878817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.878920 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879104 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879430 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879615 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879876 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.879970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.880068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.880212 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.880304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.880400 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.880489 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.880585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.881253 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.881391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.881488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.881578 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.881673 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.881832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.881927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882110 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882523 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882621 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882710 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.882936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.883080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.883172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.883260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.883394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.883511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.883678 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.883796 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.883912 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884281 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884669 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.884950 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885037 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885525 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885620 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.885962 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886107 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886756 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886844 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.886937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887039 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887411 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.887930 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.888057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.888251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.888362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.888585 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.888689 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.888877 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.889019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.889201 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.889354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.889515 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.889644 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.889995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.890166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.890322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.890521 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.890639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.890844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.890940 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.891176 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.891322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.891505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.891637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.891826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.892060 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.892168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.892373 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.892477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.892705 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.892803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.893029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.893170 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.893343 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.893438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.893657 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.893801 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.893989 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.894097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.894295 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.894402 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.894602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.894696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.894905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.895172 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.895316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.895449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.895565 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.895692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.895817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.895941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.896153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.896390 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.897066 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.897186 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.897312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.897505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.897613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.897739 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.897931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.898058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.907259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.907259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.907547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.907641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.907742 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.907943 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908149 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908238 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908703 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908886 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.908973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909073 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909169 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.909955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910051 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910227 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910333 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910751 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910852 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.910948 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911124 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911210 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911407 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911503 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.911969 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.912240 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.912414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.912521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.912611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.912700 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.912839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.912940 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913129 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913217 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913307 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913472 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913546 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913830 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.913944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914043 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914427 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914520 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914714 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.914996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915468 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915557 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915651 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915755 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915851 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.915939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916299 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916684 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916772 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.916872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.917046 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.917135 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.917454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.917454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.917645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.917645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.917848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.917946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918289 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918468 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918741 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918830 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918830 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.918992 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.919988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920084 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920357 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920551 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920684 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.920980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921174 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921262 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921442 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.921875 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922115 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922830 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.922967 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923356 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923453 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923628 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.923917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924322 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924847 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.924941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925132 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925226 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925648 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.925905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.926026 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.926188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.926287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.926495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.926597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.926805 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.926911 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.927113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.927213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.927425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.927600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.927755 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.927919 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.928106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.928319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.928466 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.928616 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.928753 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.928863 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.929049 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.929354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.929529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.929672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.929866 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.930001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.930184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.930297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.930494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.930601 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.930815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.935914 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936091 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936186 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936737 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.936921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937007 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937352 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937551 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937647 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937743 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.937912 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938002 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938090 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938183 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938272 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938545 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.938921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939100 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939194 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939282 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939671 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.939904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940119 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940219 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940396 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940587 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940688 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.940911 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941105 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941291 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941579 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941863 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.941955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942092 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942738 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.942921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.943017 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.943154 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.943825 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.943918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944111 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944297 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944386 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944480 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944715 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.944995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.945082 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.945082 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.945247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.945344 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:37:11.945434 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.945589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.945944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.946302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.946619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.946934 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.947251 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.947563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.947873 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.948191 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.948506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.948830 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.949153 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.949461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.949805 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.950137 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.950481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.950791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.951130 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.951456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.951768 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.952076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.952394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:37:11.952665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:37:12.007597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO dbcounter [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Registered counter for database nova_api Aug 24 14:37:12.015331 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO dbcounter [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Registered counter for database nova_api Aug 24 14:37:12.028617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_db.sqlalchemy.engines [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:37:12.035476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writer thread running {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:37:12.036161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_db.sqlalchemy.engines [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:37:12.042773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writer thread running {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:37:12.091980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.context [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),394a1067-454b-4b02-98e2-91da0c17a51a(cell1) {{(pid=132890) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:37:12.096071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:12.096554 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:12.098229 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:12.098453 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.context [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),394a1067-454b-4b02-98e2-91da0c17a51a(cell1) {{(pid=132892) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 14:37:12.098989 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:12.100003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:12.102213 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:12.103133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:12.103609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:12.104216 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO dbcounter [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Registered counter for database nova_cell0 Aug 24 14:37:12.105188 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:12.105959 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:37:12.106412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:37:12.108345 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO dbcounter [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Registered counter for database nova_cell1 Aug 24 14:37:12.108495 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:37:12.110384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO dbcounter [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Registered counter for database nova_cell0 Aug 24 14:37:12.114620 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO dbcounter [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Registered counter for database nova_cell1 Aug 24 14:37:12.116998 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_db.sqlalchemy.engines [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:37:12.119059 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_db.sqlalchemy.engines [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:37:12.122392 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_db.sqlalchemy.engines [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:37:12.124534 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_db.sqlalchemy.engines [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:37:12.126186 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writer thread running {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:37:12.127500 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writer thread running {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:37:12.129715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writer thread running {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:37:12.271791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writer thread running {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:37:12.279653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO dbcounter [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Registered counter for database nova_cell0 Aug 24 14:37:12.281845 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO dbcounter [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Registered counter for database nova_cell0 Aug 24 14:37:12.286505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_db.sqlalchemy.engines [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:37:12.291740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writer thread running {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:37:12.292025 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_db.sqlalchemy.engines [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:37:12.297223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writer thread running {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:37:12.609253 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: WARNING keystonemiddleware.auth_token [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:37:12.617498 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: WARNING keystonemiddleware.auth_token [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:37:12.620281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: WARNING keystonemiddleware.auth_token [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:37:12.627701 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: WARNING keystonemiddleware.auth_token [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:37:12.962745 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: WARNING keystonemiddleware.auth_token [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:37:12.968689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: WARNING keystonemiddleware.auth_token [None req-f033c5a6-fd8f-4831-8111-20526918cbc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:37:12.974007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563e041709c0 pid: 132890 (default app) Aug 24 14:37:12.976774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: WARNING keystonemiddleware.auth_token [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 14:37:12.982835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: WARNING keystonemiddleware.auth_token [None req-2de90e62-4d71-4dbb-af94-5d0094822d0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 14:37:12.988438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563e041709c0 pid: 132892 (default app) Aug 24 14:37:48.929710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=3 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.930656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=3 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.931381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=3 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.932112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=3 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:50.229836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-33831487-0d3a-4a6f-974b-ffb4ee2b9589 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] Action: 'create', calling method: .version_select at 0x7fbf79a858b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-43250375", "metadata": {"Type": "work"}}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:37:52.171852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-33831487-0d3a-4a6f-974b-ffb4ee2b9589 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.256754 Aug 24 14:37:52.172601 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 24 14:37:48 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3259 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 14:37:52.201361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:52.205388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:52.209843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:52.213200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:52.743366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-19d56b63-e708-42af-a191-5d97ad1f71f4 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] Calling method '.version_select at 0x7fbf79a5a430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:53.633544 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9b25efcf-bc14-4c55-abd3-e0297a1f8778 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf798de700>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:53.662235 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-19d56b63-e708-42af-a191-5d97ad1f71f4 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed" status: 200 len: 352 microversion: 2.1 time: 1.475681 Aug 24 14:37:53.669850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 1/2] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:37:52 2022] GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed => generated 352 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:53.678582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-da7f9e36-3473-45bc-9be4-ff610a10cc57 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] Calling method '.version_select at 0x7fbf7991b8b0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:53.733677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-da7f9e36-3473-45bc-9be4-ff610a10cc57 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed" status: 200 len: 352 microversion: 2.1 time: 0.060020 Aug 24 14:37:53.740511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9b25efcf-bc14-4c55-abd3-e0297a1f8778 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ad9bad60-5fa8-4a2e-a9e1-86e9f74e2f6a" status: 200 len: 351 microversion: 2.1 time: 0.112303 Aug 24 14:37:53.741229 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:37:53 2022] GET /compute/v2.1/os-volumes/ad9bad60-5fa8-4a2e-a9e1-86e9f74e2f6a => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:37:53.746159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:37:53 2022] GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:53.754767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-90b2248e-9f5b-42b0-9272-bb778502f4bc tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] Calling method '.version_select at 0x7fbf798deee0>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:54.109536 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-90b2248e-9f5b-42b0-9272-bb778502f4bc tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed" status: 202 len: 0 microversion: 2.1 time: 0.355177 Aug 24 14:37:54.109536 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 3/5] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:37:53 2022] DELETE /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:37:54.116596 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78c07778-6c00-4c7f-a0bb-513897fa61f0 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] Calling method '.version_select at 0x7fbf7991be50>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:54.209898 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78c07778-6c00-4c7f-a0bb-513897fa61f0 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed" status: 200 len: 351 microversion: 2.1 time: 0.098178 Aug 24 14:37:54.211641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 3/6] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:37:54 2022] GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:55.225654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-99fa7709-6b5b-4d22-a1ae-20a950ab78e7 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] Calling method '.version_select at 0x7fbf798f15e0>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:55.277247 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-99fa7709-6b5b-4d22-a1ae-20a950ab78e7 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] HTTP exception thrown: Volume 22358624-5417-4374-b49d-de33c95b57ed could not be found. Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-99fa7709-6b5b-4d22-a1ae-20a950ab78e7 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] Request method failure captured: Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed HTTP/1.1 Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBje8vtIxSQBJXQ9vYUCT0JEG1b9jDQnIv7bmrL9My4KJ283RmO2w2nSqZnt627G2pcv1asgXpvdTDeKP6a_WZomCPrz_0GxjPpIv6SNvtL3RFgvFwWo8SUAK3ER-YKpOfOtToYLJ0BwOmPXIIMUJ-UG75RIa_gkOTTc0vAyiKYiZwio Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: d2659c6241284e89b2acf6cfd8ae24f0 Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-VolumesGetTestJSON-1927126937 Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:37:55.284873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2659c6241284e89b2acf6cfd8ae24f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2659c6241284e89b2acf6cfd8ae24f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2659c6241284e89b2acf6cfd8ae24f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2659c6241284e89b2acf6cfd8ae24f0"}]}] Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-VolumesGetTestJSON-1927126937 Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: d2659c6241284e89b2acf6cfd8ae24f0 Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-VolumesGetTestJSON-1927126937 Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-VolumesGetTestJSON-1927126937-project Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 31fba1b1ca7f412aa374a6e7298e32b7 Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-VolumesGetTestJSON-1927126937-project Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Volume 22358624-5417-4374-b49d-de33c95b57ed could not be found. Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '22358624-5417-4374-b49d-de33c95b57ed'} Aug 24 14:37:55.286245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22358624-5417-4374-b49d-de33c95b57ed could not be found. (HTTP 404) (Request-ID: req-c3df17cd-1b3b-4395-ade7-8cb3db83a180) Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:37:55.287559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:37:55.289731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22358624-5417-4374-b49d-de33c95b57ed could not be found. Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:37:55.292457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22358624-5417-4374-b49d-de33c95b57ed could not be found. Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22358624-5417-4374-b49d-de33c95b57ed could not be found. Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-99fa7709-6b5b-4d22-a1ae-20a950ab78e7 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] Returning 404 to user: Volume 22358624-5417-4374-b49d-de33c95b57ed could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-99fa7709-6b5b-4d22-a1ae-20a950ab78e7 tempest-VolumesGetTestJSON-1927126937 tempest-VolumesGetTestJSON-1927126937-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed" status: 404 len: 109 microversion: 2.1 time: 0.063058 Aug 24 14:37:55.294567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:37:55 2022] GET /compute/v2.1/os-volumes/22358624-5417-4374-b49d-de33c95b57ed => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:37:55.606068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0cd365dd-fb26-435e-a636-28500506b0ff tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf7991bca0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:55.737179 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0cd365dd-fb26-435e-a636-28500506b0ff tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/466bc3c7-ecf3-46a1-b33c-aa415634693c" status: 200 len: 350 microversion: 2.1 time: 0.141959 Aug 24 14:37:55.746697 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:37:55 2022] GET /compute/v2.1/os-volumes/466bc3c7-ecf3-46a1-b33c-aa415634693c => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:59.495290 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-be506e0f-d1a7-49c9-959d-d1c2e483bf4d tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf798dee50>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:37:59.593327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-be506e0f-d1a7-49c9-959d-d1c2e483bf4d tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/9a4b863e-fb65-4f3b-b572-8961d4c0f3d0" status: 200 len: 350 microversion: 2.1 time: 0.102807 Aug 24 14:37:59.593924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 5/9] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:37:59 2022] GET /compute/v2.1/os-volumes/9a4b863e-fb65-4f3b-b572-8961d4c0f3d0 => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:37:59.608074 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d43ffd0e-8438-478f-a297-cfa1442f0c08 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf7991b700>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:00.073804 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d43ffd0e-8438-478f-a297-cfa1442f0c08 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.470610 Aug 24 14:38:00.078257 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 5/10] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 24 14:37:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:00.105093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4eddf708-5435-424d-961c-d4cc18d48a87 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf7985f550>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:00.281767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4eddf708-5435-424d-961c-d4cc18d48a87 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.180889 Aug 24 14:38:00.282645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 6/11] 10.222.0.65 () {58 vars in 1149 bytes} [Wed Aug 24 14:38:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:00.299424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-77885c99-bb7c-4167-b6ba-5499392f209a tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf7991bd30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:00.457182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-77885c99-bb7c-4167-b6ba-5499392f209a tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.161750 Aug 24 14:38:00.459324 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 24 14:38:00 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:00.471937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a020425e-e063-4422-b16c-dce4bfe7e672 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf7985f1f0>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:00.706947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a020425e-e063-4422-b16c-dce4bfe7e672 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.238725 Aug 24 14:38:00.710789 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1167 bytes} [Wed Aug 24 14:38:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:00.727680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-31025e31-14c4-49e2-b1c9-63b9ad993b5c tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf798e0af0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:00.973790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-31025e31-14c4-49e2-b1c9-63b9ad993b5c tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.252803 Aug 24 14:38:00.974609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 7/14] 10.222.0.65 () {58 vars in 1170 bytes} [Wed Aug 24 14:38:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:00.993729 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a15431bf-71d3-44b1-8e1a-445ac3c1be22 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf7985e820>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:01.174339 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a15431bf-71d3-44b1-8e1a-445ac3c1be22 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.190155 Aug 24 14:38:01.175323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 8/15] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 24 14:38:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:01.189483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9830bcf6-95b9-498a-a1e2-8f4a13526983 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf798e0280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:01.428184 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9830bcf6-95b9-498a-a1e2-8f4a13526983 tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.243465 Aug 24 14:38:01.429094 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1188 bytes} [Wed Aug 24 14:38:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:01.448025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1242a71b-77ef-452f-9972-6cc1bf4b84ad tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] Calling method '.version_select at 0x7fbf798fda60>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:01.713479 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1242a71b-77ef-452f-9972-6cc1bf4b84ad tempest-VolumesTestJSON-1161576719 tempest-VolumesTestJSON-1161576719-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.274577 Aug 24 14:38:01.714859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 9/17] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 24 14:38:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:03.611281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1796842964", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "networks": [{"uuid": "8044a7e8-b37b-452c-aa75-735529267463"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:03.792506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] validate_networks() for [('8044a7e8-b37b-452c-aa75-735529267463', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:38:04.561556 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-389a2da2-45ff-44b0-b05e-17365741f35a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'create', calling method: .version_select at 0x7fbf7985fe50>, body: {"keypair": {"name": "tempest-keypair-455384548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2wahIoWiFYJj/rMqPlbShCmSVZLY4StC6pKvtULs8KdDrv0Ar+cBc/n4Xqr30hyqLj14Q8M5usRyuhPrXBgfGM8BLFHp/sNrLB2/UcHFSJkS+8MDbFpPfJ+wGa11EKuQ=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:04.672072 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-389a2da2-45ff-44b0-b05e-17365741f35a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Getting quotas for project 25aaf7039f994f4a83bf8ce6db68f3a1. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:38:04.691835 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-389a2da2-45ff-44b0-b05e-17365741f35a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Getting quotas for user fbdf19910c234794b8aeb480dba50d85 and project 25aaf7039f994f4a83bf8ce6db68f3a1. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:38:04.892205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-389a2da2-45ff-44b0-b05e-17365741f35a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.716718 Aug 24 14:38:04.900579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 10/18] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 24 14:38:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 718 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 14:38:06.840182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:38:06.841606 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:38:06.842263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:38:06.842951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:38:06.843844 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:38:06.918618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:06.919433 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:06.920022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:06.920982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:06.924150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:06.924781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:07.025826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Getting quotas for project 3afce3a011534835893040caf18b19a5. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:38:07.057900 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Getting quotas for user 7b0a0a0664744f378ca4e17e914f4259 and project 3afce3a011534835893040caf18b19a5. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:38:07.109687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:38:07.112745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:38:07.448581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c35d1f73-43bd-4ece-a63e-ff1b8db4cbef tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.095398 Aug 24 14:38:07.449895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 9/19] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:38:07.465079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-71c5baab-7522-4634-af4f-15213c38f9bc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:07.465879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-71c5baab-7522-4634-af4f-15213c38f9bc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:07.731658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-71c5baab-7522-4634-af4f-15213c38f9bc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:07.776764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-71c5baab-7522-4634-af4f-15213c38f9bc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1215 microversion: 2.1 time: 0.317642 Aug 24 14:38:07.780287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 11/20] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:07 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1215 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:08.803384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac391044-b66f-4443-bbb8-2972d93afab6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:08.804405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac391044-b66f-4443-bbb8-2972d93afab6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:09.091723 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac391044-b66f-4443-bbb8-2972d93afab6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:09.109200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac391044-b66f-4443-bbb8-2972d93afab6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1215 microversion: 2.1 time: 0.311968 Aug 24 14:38:09.110697 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 10/21] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:08 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:10.134710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ac5e7509-4fab-4452-b176-bd620799b2f6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:10.135782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ac5e7509-4fab-4452-b176-bd620799b2f6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:10.412281 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ac5e7509-4fab-4452-b176-bd620799b2f6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:10.438196 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ac5e7509-4fab-4452-b176-bd620799b2f6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1215 microversion: 2.1 time: 0.309123 Aug 24 14:38:10.453707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 12/22] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:10 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:11.477825 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:11.479141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:11.493282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:11.506567 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:11.507182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:11.508058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:11.508764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:11.509292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:12.003849 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:12.053112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ab4955e1-8b6d-411a-8d6f-0f7f4125fa0c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1219 microversion: 2.1 time: 0.575733 Aug 24 14:38:12.067905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 11/23] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:11 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1219 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:12.300810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9d7c0348-bc44-4425-9658-3cbb6338ad0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'create', calling method: .version_select at 0x7fbf78fb9160>, body: {"keypair": {"name": "tempest-keypair-1778787705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrAVgdykoE86YdBPfEkd0alVKyoMzeBz77BdyWjY4mzXGjupNHhjLtc/24iCARddFRY068di9rCF7xjYnLHkFe7RmRLUWXi6s+BZVFfo3p/G72eQoQIiKKNOa9OaNjf6Q=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:12.334714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-9d7c0348-bc44-4425-9658-3cbb6338ad0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Getting quotas for project 2395c1dafb6a4174a7dd095c4809c181. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:38:12.339870 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-9d7c0348-bc44-4425-9658-3cbb6338ad0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Getting quotas for user 556b3a886df740cda4a94e55d2fcc08a and project 2395c1dafb6a4174a7dd095c4809c181. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:38:12.460519 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9d7c0348-bc44-4425-9658-3cbb6338ad0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.766420 Aug 24 14:38:12.462066 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 13/24] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:38:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:12.735114 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-51244727", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "553ca834-cedd-40ba-ae2f-786373c0276f"}], "security_groups": [{"name": "tempest-securitygroup--1477430234"}], "key_name": "tempest-keypair-455384548", "user_data": "}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:13.038740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-568454183", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:13.118591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] validate_networks() for [('553ca834-cedd-40ba-ae2f-786373c0276f', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:38:13.248819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] validate_networks() for [('0959b601-d8f6-44ff-a066-1c3353918db7', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:38:14.258065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:38:14.258607 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:38:14.259100 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:38:14.259725 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:38:14.260443 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:38:14.302165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.304051 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.304503 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:14.306637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.307264 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.308648 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:14.340200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Getting quotas for project 6c5abfb715e14ddf84e0b4519a3d724b. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:38:14.345883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Getting quotas for user 3acc0010e3f54283934b75f58bb6ec93 and project 6c5abfb715e14ddf84e0b4519a3d724b. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:38:14.369867 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:38:14.385807 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:38:14.639958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-94e20f9a-d19d-444f-a66b-ce82ca9be41b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.570651 Aug 24 14:38:14.656564 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 12/25] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:38:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:38:14.662234 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:14.662853 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:14.670266 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.670936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.671345 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:14.672236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:14.672882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:14.673464 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:14.879981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:14.899883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a7618529-70f1-4eb2-863c-5ef51a61d886 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1273 microversion: 2.1 time: 0.242209 Aug 24 14:38:14.917931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 13/26] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:14 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:14.934040 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-58b2cf21-3668-4f23-837f-97ea2b08144b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:14.934657 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-58b2cf21-3668-4f23-837f-97ea2b08144b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:15.073075 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-58b2cf21-3668-4f23-837f-97ea2b08144b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:15.092078 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-58b2cf21-3668-4f23-837f-97ea2b08144b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1221 microversion: 2.1 time: 0.164945 Aug 24 14:38:15.097515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 14/27] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:14 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:15.931447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:38:15.932702 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:38:15.933412 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:38:15.934114 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:38:15.934726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:38:15.956931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:15.959949 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:15.980794 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:15.982521 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:15.990323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:16.002696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:16.099419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Getting quotas for project 25aaf7039f994f4a83bf8ce6db68f3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:38:16.109245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Getting quotas for user fbdf19910c234794b8aeb480dba50d85 and project 25aaf7039f994f4a83bf8ce6db68f3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:38:16.138519 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:38:16.153788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:38:16.444569 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-90de97f4-032a-4830-a218-d497855543b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.714660 Aug 24 14:38:16.456252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 14/28] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 24 14:38:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 3717 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 14:38:16.499770 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1506644071", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:16.712873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] validate_networks() for [('0959b601-d8f6-44ff-a066-1c3353918db7', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:38:17.006659 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3c3072d6-1dc1-4e93-9fef-e2201293a078 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Action: 'create', calling method: .version_select at 0x7fbf786fdca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1499053029", "metadata": {"Type": "work"}}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3c3072d6-1dc1-4e93-9fef-e2201293a078 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Request method failure captured: Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 122 Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfXizVIR5p9PTL9B_el_D4zKxMhuo8vFWJlFh-hGYQZoSULijebLznvJnJhOEjqiE5rKqxU5vatO2AbNx85YXBJxdzxDggac_iLPSV-8wZxIY8lZ1Lrj7L9YNNPCUD45VN_lrkW1KL5Jsc3gom3dhTHy5uAUp0ZXQV82qFrdG1o5XY Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:38:17.011259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_64ee0694e58e493488db4c40273a1b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}] Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 86590cc2b82448259f60de3d85d3677b Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1499053029", "metadata": {"Type": "work"}}} Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: Aug 24 14:38:17.012492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1499053029', 'metadata': {'Type': 'work'}}}} Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:38:17.013206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:38:17.015019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:38:17.015951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 14:38:17.015951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:17.015951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3c3072d6-1dc1-4e93-9fef-e2201293a078 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:38:17.018943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3c3072d6-1dc1-4e93-9fef-e2201293a078 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.481072 Aug 24 14:38:17.023065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 15/29] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 24 14:38:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1492 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:38:17.049359 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:17.050015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:17.092802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:17.093300 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:17.096091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:17.102122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:17.102122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:17.102122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.119544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:18.137832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-273e73e1-c622-4219-aa67-403e20987b83 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 1.109902 Aug 24 14:38:18.140555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 16/30] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:17 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:18.166408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-183ca9a7-5e95-4bd5-a1b8-a2f6bf5bc8a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:18.166408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-183ca9a7-5e95-4bd5-a1b8-a2f6bf5bc8a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:18.413678 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-183ca9a7-5e95-4bd5-a1b8-a2f6bf5bc8a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:18.421932 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-183ca9a7-5e95-4bd5-a1b8-a2f6bf5bc8a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:18.423444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-183ca9a7-5e95-4bd5-a1b8-a2f6bf5bc8a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:18.424575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-183ca9a7-5e95-4bd5-a1b8-a2f6bf5bc8a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1279 microversion: 2.20 time: 0.265674 Aug 24 14:38:18.425242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 17/31] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:18 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:18.448447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a0fba486-4874-4ae7-80a8-9ef71897c98d tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Action: 'create', calling method: .version_select at 0x7fbf786fb550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1807373240", "metadata": {"Type": "work"}}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a0fba486-4874-4ae7-80a8-9ef71897c98d tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Request method failure captured: Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 120 Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfXizVIR5p9PTL9B_el_D4zKxMhuo8vFWJlFh-hGYQZoSULijebLznvJnJhOEjqiE5rKqxU5vatO2AbNx85YXBJxdzxDggac_iLPSV-8wZxIY8lZ1Lrj7L9YNNPCUD45VN_lrkW1KL5Jsc3gom3dhTHy5uAUp0ZXQV82qFrdG1o5XY Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:38:18.461947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_64ee0694e58e493488db4c40273a1b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}] Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 86590cc2b82448259f60de3d85d3677b Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1807373240", "metadata": {"Type": "work"}}} Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: Aug 24 14:38:18.465480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1807373240', 'metadata': {'Type': 'work'}}}} Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi '0' Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:38:18.466199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:38:18.467529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:38:18.468654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 14:38:18.468654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.468654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a0fba486-4874-4ae7-80a8-9ef71897c98d tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:38:18.468654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a0fba486-4874-4ae7-80a8-9ef71897c98d tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037679 Aug 24 14:38:18.470308 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 18/32] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 24 14:38:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:38:18.485157 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e3b62964-f78e-41c4-a440-9c7ccf52ea15 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Action: 'create', calling method: .version_select at 0x7fbf78717ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1834714928", "metadata": {"Type": "work"}}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e3b62964-f78e-41c4-a440-9c7ccf52ea15 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Request method failure captured: Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 119 Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfXizVIR5p9PTL9B_el_D4zKxMhuo8vFWJlFh-hGYQZoSULijebLznvJnJhOEjqiE5rKqxU5vatO2AbNx85YXBJxdzxDggac_iLPSV-8wZxIY8lZ1Lrj7L9YNNPCUD45VN_lrkW1KL5Jsc3gom3dhTHy5uAUp0ZXQV82qFrdG1o5XY Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:38:18.518381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_64ee0694e58e493488db4c40273a1b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}] Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 86590cc2b82448259f60de3d85d3677b Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1834714928", "metadata": {"Type": "work"}}} Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: Aug 24 14:38:18.526398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1834714928', 'metadata': {'Type': 'work'}}}} Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise error Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi '' Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:38:18.527416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 14:38:18.528757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 14:38:18.529890 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 14:38:18.529890 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.529890 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e3b62964-f78e-41c4-a440-9c7ccf52ea15 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:38:18.529890 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e3b62964-f78e-41c4-a440-9c7ccf52ea15 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.044725 Aug 24 14:38:18.535266 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 19/33] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 24 14:38:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:38:18.550319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d4cb9cff-ae96-494a-94fb-569784c9007f tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Calling method '.version_select at 0x7fbf78728a60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:18.648751 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-d4cb9cff-ae96-494a-94fb-569784c9007f tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] HTTP exception thrown: Volume tempest-invalid-23232752 could not be found. Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d4cb9cff-ae96-494a-94fb-569784c9007f tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Request method failure captured: Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-23232752 HTTP/1.1 Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfXizVIR5p9PTL9B_el_D4zKxMhuo8vFWJlFh-hGYQZoSULijebLznvJnJhOEjqiE5rKqxU5vatO2AbNx85YXBJxdzxDggac_iLPSV-8wZxIY8lZ1Lrj7L9YNNPCUD45VN_lrkW1KL5Jsc3gom3dhTHy5uAUp0ZXQV82qFrdG1o5XY Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:38:18.652913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_64ee0694e58e493488db4c40273a1b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}] Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 86590cc2b82448259f60de3d85d3677b Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Volume tempest-invalid-23232752 could not be found. Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'tempest-invalid-23232752'} Aug 24 14:38:18.654529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-23232752 could not be found. (HTTP 404) (Request-ID: req-97cd7182-0810-4bec-bd52-6fb8b63cd4ff) Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.655180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:38:18.656165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-23232752 could not be found. Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:38:18.657706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-23232752 could not be found. Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-23232752 could not be found. Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d4cb9cff-ae96-494a-94fb-569784c9007f tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Returning 404 to user: Volume tempest-invalid-23232752 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d4cb9cff-ae96-494a-94fb-569784c9007f tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-23232752" status: 404 len: 97 microversion: 2.1 time: 0.117486 Aug 24 14:38:18.666954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 20/34] 10.222.0.65 () {58 vars in 1212 bytes} [Wed Aug 24 14:38:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-23232752 => generated 97 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 14:38:18.675751 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-790bafec-cff1-4de8-999a-b1db437a0040 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003787 Aug 24 14:38:18.675751 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 21/35] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 24 14:38:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 14:38:18.697480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-069f3486-8b05-431c-9d4a-8e2748f9116e tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013173 Aug 24 14:38:18.700256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 22/36] 10.222.0.65 () {58 vars in 1137 bytes} [Wed Aug 24 14:38:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 14:38:18.723810 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-824ca69f-68f7-4c25-bad2-40205344efd0 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Calling method '.version_select at 0x7fbf786fdaf0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:18.736929 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:38:18.737334 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:38:18.737711 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:38:18.738277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:38:18.739695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:38:18.806045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:18.806045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:18.806045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.814810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:18.823037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:18.824010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:18.835439 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-824ca69f-68f7-4c25-bad2-40205344efd0 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] HTTP exception thrown: Volume 91d69559-cb12-4f45-be42-af745bd66e2a could not be found. Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-824ca69f-68f7-4c25-bad2-40205344efd0 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Request method failure captured: Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/os-volumes/91d69559-cb12-4f45-be42-af745bd66e2a HTTP/1.1 Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfXizVIR5p9PTL9B_el_D4zKxMhuo8vFWJlFh-hGYQZoSULijebLznvJnJhOEjqiE5rKqxU5vatO2AbNx85YXBJxdzxDggac_iLPSV-8wZxIY8lZ1Lrj7L9YNNPCUD45VN_lrkW1KL5Jsc3gom3dhTHy5uAUp0ZXQV82qFrdG1o5XY Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:38:18.836782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_64ee0694e58e493488db4c40273a1b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}] Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 86590cc2b82448259f60de3d85d3677b Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Volume 91d69559-cb12-4f45-be42-af745bd66e2a could not be found. Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '91d69559-cb12-4f45-be42-af745bd66e2a'} Aug 24 14:38:18.837978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91d69559-cb12-4f45-be42-af745bd66e2a could not be found. (HTTP 404) (Request-ID: req-558dc10e-e95b-47ad-9fe5-b7406ad703ac) Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.838650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:38:18.839547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91d69559-cb12-4f45-be42-af745bd66e2a could not be found. Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:38:18.840987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91d69559-cb12-4f45-be42-af745bd66e2a could not be found. Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91d69559-cb12-4f45-be42-af745bd66e2a could not be found. Aug 24 14:38:18.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.845738 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-824ca69f-68f7-4c25-bad2-40205344efd0 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Returning 404 to user: Volume 91d69559-cb12-4f45-be42-af745bd66e2a could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:38:18.847296 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-824ca69f-68f7-4c25-bad2-40205344efd0 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/91d69559-cb12-4f45-be42-af745bd66e2a" status: 404 len: 109 microversion: 2.1 time: 0.141180 Aug 24 14:38:18.848394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 23/37] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:38:18 2022] DELETE /compute/v2.1/os-volumes/91d69559-cb12-4f45-be42-af745bd66e2a => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:38:18.863057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7bbbaab7-2434-4dc9-bf23-e99d02af9310 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Calling method '.version_select at 0x7fbf78728d30>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:18.896308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Getting quotas for project 6c5abfb715e14ddf84e0b4519a3d724b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:38:18.921986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Getting quotas for user 3acc0010e3f54283934b75f58bb6ec93 and project 6c5abfb715e14ddf84e0b4519a3d724b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:38:18.955578 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-7bbbaab7-2434-4dc9-bf23-e99d02af9310 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] HTTP exception thrown: Volume a0bf1109-25be-4fc5-af99-249dc6448510 could not be found. Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7bbbaab7-2434-4dc9-bf23-e99d02af9310 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Request method failure captured: Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/os-volumes/a0bf1109-25be-4fc5-af99-249dc6448510 HTTP/1.1 Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfXizVIR5p9PTL9B_el_D4zKxMhuo8vFWJlFh-hGYQZoSULijebLznvJnJhOEjqiE5rKqxU5vatO2AbNx85YXBJxdzxDggac_iLPSV-8wZxIY8lZ1Lrj7L9YNNPCUD45VN_lrkW1KL5Jsc3gom3dhTHy5uAUp0ZXQV82qFrdG1o5XY Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:38:18.958771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_64ee0694e58e493488db4c40273a1b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64ee0694e58e493488db4c40273a1b32"}]}] Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 64ee0694e58e493488db4c40273a1b32 Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-1574881041 Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 86590cc2b82448259f60de3d85d3677b Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-1574881041-project Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Volume a0bf1109-25be-4fc5-af99-249dc6448510 could not be found. Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'a0bf1109-25be-4fc5-af99-249dc6448510'} Aug 24 14:38:18.959883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0bf1109-25be-4fc5-af99-249dc6448510 could not be found. (HTTP 404) (Request-ID: req-022e4bb2-f21d-49b5-b313-dd1faa316cab) Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.960820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:38:18.962008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0bf1109-25be-4fc5-af99-249dc6448510 could not be found. Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:38:18.962878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0bf1109-25be-4fc5-af99-249dc6448510 could not be found. Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0bf1109-25be-4fc5-af99-249dc6448510 could not be found. Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7bbbaab7-2434-4dc9-bf23-e99d02af9310 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] Returning 404 to user: Volume a0bf1109-25be-4fc5-af99-249dc6448510 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7bbbaab7-2434-4dc9-bf23-e99d02af9310 tempest-VolumesNegativeTest-1574881041 tempest-VolumesNegativeTest-1574881041-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/a0bf1109-25be-4fc5-af99-249dc6448510" status: 404 len: 109 microversion: 2.1 time: 0.106641 Aug 24 14:38:18.963811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 24/38] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:38:18 2022] GET /compute/v2.1/os-volumes/a0bf1109-25be-4fc5-af99-249dc6448510 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:38:18.966532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:38:18.969414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:38:19.176243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:19.176243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:19.176243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:19.176243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:19.181354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:19.182219 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:19.182732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:19.183148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:19.266523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f9a86513-23fd-4180-a7d1-6790efc510aa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.806170 Aug 24 14:38:19.269231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 15/39] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:38:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:38:19.357127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8e0d76c5-8929-430a-9647-fe130d709fad tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:19.360257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8e0d76c5-8929-430a-9647-fe130d709fad tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:19.763358 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8e0d76c5-8929-430a-9647-fe130d709fad tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:19.773631 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8e0d76c5-8929-430a-9647-fe130d709fad tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1222 microversion: 2.1 time: 0.468743 Aug 24 14:38:19.779091 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 16/40] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:19 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1222 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:19.801552 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:19.806846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:19.850390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:19.856265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:19.856265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:19.856265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:19.862165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:19.866145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:20.056826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:20.070067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-097cb6e8-19e6-497c-a4a5-bed260344f2c tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.911879 Aug 24 14:38:20.072657 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 25/41] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:19 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:20.091457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-189311372", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d711b7b4-bb60-42ae-97dc-7788e7f576aa"}], "security_groups": [{"name": "tempest-securitygroup--2121597768"}], "key_name": "tempest-keypair-1778787705", "user_data": "}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:20.673815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:20.696915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:20.735222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:20.738056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-01588191-81db-44b4-a771-7e2e705e558b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1331 microversion: 2.20 time: 0.957144 Aug 24 14:38:20.760219 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 17/42] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:19 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1331 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:20.800105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] validate_networks() for [('d711b7b4-bb60-42ae-97dc-7788e7f576aa', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:38:20.804172 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0c4c0515-f547-45a2-b07b-4335f07cc8ee tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:20.805415 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0c4c0515-f547-45a2-b07b-4335f07cc8ee tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:21.161901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0c4c0515-f547-45a2-b07b-4335f07cc8ee tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:21.176669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0c4c0515-f547-45a2-b07b-4335f07cc8ee tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1222 microversion: 2.1 time: 0.373876 Aug 24 14:38:21.178877 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 18/43] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:20 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1222 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:21.189166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:21.190249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:21.197675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:21.198539 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:21.199235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:21.200137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:21.200937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:21.202169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:22.483445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:22.492918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7b1084e4-23ad-48fa-8577-afc04598d142 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 1.311152 Aug 24 14:38:22.493503 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 19/44] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:21 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:22.660671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-62e395ed-d640-48a5-b1cc-b921c7ec4fdc req-7062eb21-b4ec-4fbf-97da-6ea9c0211d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c668d6f9-dc62-4c9c-800a-52cad818260f", "tag": "641a28bc-5369-473e-8531-fd1a1fee6294"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:22.692902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-62e395ed-d640-48a5-b1cc-b921c7ec4fdc req-7062eb21-b4ec-4fbf-97da-6ea9c0211d65 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:22.693389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-62e395ed-d640-48a5-b1cc-b921c7ec4fdc req-7062eb21-b4ec-4fbf-97da-6ea9c0211d65 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:22.693878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-62e395ed-d640-48a5-b1cc-b921c7ec4fdc req-7062eb21-b4ec-4fbf-97da-6ea9c0211d65 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:22.743635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-62e395ed-d640-48a5-b1cc-b921c7ec4fdc req-7062eb21-b4ec-4fbf-97da-6ea9c0211d65 service nova] Creating event network-changed:641a28bc-5369-473e-8531-fd1a1fee6294 for instance c668d6f9-dc62-4c9c-800a-52cad818260f on hv-cinder-75671 Aug 24 14:38:22.744189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-62e395ed-d640-48a5-b1cc-b921c7ec4fdc req-7062eb21-b4ec-4fbf-97da-6ea9c0211d65 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 14:38:22.744579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-62e395ed-d640-48a5-b1cc-b921c7ec4fdc req-7062eb21-b4ec-4fbf-97da-6ea9c0211d65 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 14:38:22.745727 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:22.746228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:22.746670 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:22.747414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:22.747868 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:22.748292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:22.778911 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.compute.rpcapi [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 14:38:22.779840 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] Releasing lock "compute-rpcapi-router" {{(pid=132890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 14:38:22.838667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f1a7101c-eb43-4de4-9698-f671bcf3ea32 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.343708 Aug 24 14:38:22.839476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 20/45] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:22.845224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:22.845446 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:22.871249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:22.878742 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:22.879665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:22.883649 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:22.885931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:22.890815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.162584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:23.184063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:23.184063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:23.184655 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0ef3772f-3054-4708-a878-a7122b489721 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1337 microversion: 2.20 time: 0.343662 Aug 24 14:38:23.186187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 21/46] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:22 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1337 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:23.213276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:23.219439 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:23.233106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:23.235327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:23.235994 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.239663 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:23.241259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:23.242163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.454457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:23.473427 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-432fbec9-3b57-4cf7-b7c8-45fb66af1144 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1274 microversion: 2.1 time: 0.274341 Aug 24 14:38:23.474464 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 22/47] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:23 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1274 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:23.530151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:23.539521 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:23.555547 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:23.556084 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:23.558205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.561075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:23.562343 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:23.564380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.687984 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:38:23.689099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:38:23.689845 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:38:23.690443 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:38:23.702640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:38:23.713444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:23.720818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:23.721652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:23.722610 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.724087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:23.725272 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:23.726019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:23.797317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Getting quotas for project 2395c1dafb6a4174a7dd095c4809c181. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:38:23.833882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Getting quotas for user 556b3a886df740cda4a94e55d2fcc08a and project 2395c1dafb6a4174a7dd095c4809c181. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:38:23.872325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:38:23.875015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:38:24.069717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c5ea9d31-cf56-4a91-92ce-a04401692d3e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.992907 Aug 24 14:38:24.079418 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 26/48] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:38:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 4005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:38:24.102944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2a7a4db6-70cd-427b-80e3-ac390d3b3bf1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:24.102944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2a7a4db6-70cd-427b-80e3-ac390d3b3bf1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:24.540837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:24.555280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-19831443-9207-47ea-a9bb-7ccb645a8781 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 1.040134 Aug 24 14:38:24.562826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 23/49] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:23 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:24.568543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:24.569163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:24.595887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:24.596387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:24.602039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:24.603013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:24.606974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2a7a4db6-70cd-427b-80e3-ac390d3b3bf1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:24.608956 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:24.609688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:24.625716 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2a7a4db6-70cd-427b-80e3-ac390d3b3bf1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1237 microversion: 2.1 time: 0.529729 Aug 24 14:38:24.635726 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 27/50] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:24 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1237 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:24.651262 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:24.653395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:24.681433 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:24.684947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:24.688008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:24.690255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:24.698249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:24.702167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:24.937014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:25.006884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:25.013013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:25.015908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9b195af0-9001-41e4-84fc-38d4bedfefe4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1337 microversion: 2.20 time: 0.450696 Aug 24 14:38:25.020152 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 24/51] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:24 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1337 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:25.201647 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:25.221414 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4b660378-bc7a-4ed5-bcb0-feda69f3925a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1280 microversion: 2.1 time: 0.583688 Aug 24 14:38:25.241593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 28/52] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:24 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1280 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:25.614565 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:25.617818 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:25.650666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:25.653773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:25.656175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:25.656289 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-90d1dd89-4b75-4af9-a67a-44bad2bb3555 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:25.656790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-90d1dd89-4b75-4af9-a67a-44bad2bb3555 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:25.666037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:25.666869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:25.668083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:26.296625 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-90d1dd89-4b75-4af9-a67a-44bad2bb3555 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:26.318416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-90d1dd89-4b75-4af9-a67a-44bad2bb3555 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1237 microversion: 2.1 time: 0.666139 Aug 24 14:38:26.319047 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 29/53] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:25 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1237 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:26.324027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:26.324836 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:26.330989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:26.331765 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:26.332357 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:26.333243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:26.333907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:26.334511 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:26.743009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:26.765801 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:26.767458 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:26.768756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fcd464c1-8e50-421d-b419-c57de5642beb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1337 microversion: 2.20 time: 0.448381 Aug 24 14:38:26.789933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 30/54] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:26 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1337 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:26.791516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:26.792205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:26.810918 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:26.813250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:26.813250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:26.813250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:26.813250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:26.813558 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:26.884375 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:26.892327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-69eef021-222c-4c25-b940-82d2fecc8ef2 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 1.307336 Aug 24 14:38:26.907776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 25/55] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:25 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:27.020280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:27.030174 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8cfdc17f-3abd-429a-961e-80770482595a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1280 microversion: 2.1 time: 0.250837 Aug 24 14:38:27.031500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 31/56] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:26 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:27.344575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:27.345335 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:27.364091 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:27.364667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:27.365305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:27.366202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:27.366767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:27.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:27.617056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:27.626438 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cb67e3c3-b675-4a1a-997c-9818499ab780 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1289 microversion: 2.1 time: 0.285765 Aug 24 14:38:27.632302 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 26/57] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:27 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1289 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:27.796018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:27.797206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:27.808534 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:27.809584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:27.812172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:27.814591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:27.816949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:27.820738 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:27.921484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:27.924748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:27.955558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:27.959067 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:27.959803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:27.965309 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:27.968089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:27.968895 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:28.934993 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:28.946730 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:28.967570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:28.970372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9b99fdf1-2205-4fb6-aa11-f0490ec82da3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 1.053991 Aug 24 14:38:28.973093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:28.974379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3732131d-1890-4a0a-8c23-6d4644057c7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 1.185756 Aug 24 14:38:28.974949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 32/58] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:27 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:28.976849 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 27/59] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:27 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:28.982757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:28.992355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:28.993437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:29.003391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:29.009953 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:29.010441 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:29.012833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:29.012833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:29.012833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:29.013571 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:29.013707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:29.014232 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:29.014392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:29.014752 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:29.018386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:29.018832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:29.398256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:29.411101 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-086a7710-0422-42c8-954d-c131e8f69baf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1295 microversion: 2.1 time: 0.433083 Aug 24 14:38:29.411712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 28/60] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:28 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1295 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:29.537274 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-863072b8-51aa-4368-9f52-f2032ba4d67d req-15744abb-6b99-4aa4-923f-eaefbc57f9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279f90bd-61da-416d-9bd8-de6da5bd41ce", "tag": "0a890f22-afe5-4a9a-a3b8-506e89f9fe19"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:29.562295 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:29.565328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-863072b8-51aa-4368-9f52-f2032ba4d67d req-15744abb-6b99-4aa4-923f-eaefbc57f9e8 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:29.568308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-863072b8-51aa-4368-9f52-f2032ba4d67d req-15744abb-6b99-4aa4-923f-eaefbc57f9e8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:29.568308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-863072b8-51aa-4368-9f52-f2032ba4d67d req-15744abb-6b99-4aa4-923f-eaefbc57f9e8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:29.586533 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-863072b8-51aa-4368-9f52-f2032ba4d67d req-15744abb-6b99-4aa4-923f-eaefbc57f9e8 service nova] Creating event network-changed:0a890f22-afe5-4a9a-a3b8-506e89f9fe19 for instance 279f90bd-61da-416d-9bd8-de6da5bd41ce on hv-cinder-75671 Aug 24 14:38:29.596202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-863072b8-51aa-4368-9f52-f2032ba4d67d req-15744abb-6b99-4aa4-923f-eaefbc57f9e8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168405 Aug 24 14:38:29.597554 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 29/61] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:30.004838 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:30.005789 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:30.027538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:30.028828 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:30.038075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:30.052241 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:30.054303 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:30.055625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:30.319582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:30.355273 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-456dd087-18e0-45bb-9c27-d5f962f9c931 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 1.378949 Aug 24 14:38:30.357066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 33/62] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:28 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:30.372768 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:30.377460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:30.392280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:30.393542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:30.395111 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:30.396707 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:30.399121 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:30.400173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:31.054880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.064387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-322da526-82bf-4985-b651-6eb87827bff0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.705467 Aug 24 14:38:31.069220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 34/63] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:30 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:31.076292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:31.077371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:31.085205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:31.086035 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:31.086708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:31.087603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:31.088284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:31.104127 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:31.107155 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.120704 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.122428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.126653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-17a0c560-2ec7-4177-8eca-213325cbe805 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 1.127891 Aug 24 14:38:31.127292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 30/64] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:29 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:31.395224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:31.395224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:31.395224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=28 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:31.406590 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:31.408804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:31.408804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:31.409503 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:31.410580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:31.411686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:31.702391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.726244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-352b331e-a4f4-41ad-b399-47e73cec8e09 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.658806 Aug 24 14:38:31.728269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 35/65] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:31 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:31.937707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:31.960639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-17690e1c-c82a-42b3-aa05-9807352d57d8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.580920 Aug 24 14:38:31.962151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 31/66] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:31 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:32.099686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:32.100574 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:32.106754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.107224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.107836 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.108654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.109360 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.109810 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.178521 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:32.179608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:32.187861 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.188403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.189069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.190023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.190660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.191925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.284358 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:32.297202 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0eb86429-eb19-4e24-88b3-76323688edf3 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.201581 Aug 24 14:38:32.298101 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 36/67] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:32 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:32.364853 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:32.375114 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:32.376681 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:32.378410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f07fd9a7-4d3f-4823-b011-b9ed23210b44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.204816 Aug 24 14:38:32.379251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 32/68] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:32 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:32.476924 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-b41ac62b-0541-4e54-9d89-1bd6a4d560af req-08984413-afef-4093-8956-6ccc0dbe3cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef7e3a-316c-4347-ae40-5370582a017b", "tag": "40420387-41a5-4e65-b209-88e109f9d32e"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:32.490425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b41ac62b-0541-4e54-9d89-1bd6a4d560af req-08984413-afef-4093-8956-6ccc0dbe3cb4 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.490913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b41ac62b-0541-4e54-9d89-1bd6a4d560af req-08984413-afef-4093-8956-6ccc0dbe3cb4 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.491339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b41ac62b-0541-4e54-9d89-1bd6a4d560af req-08984413-afef-4093-8956-6ccc0dbe3cb4 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.512673 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-b41ac62b-0541-4e54-9d89-1bd6a4d560af req-08984413-afef-4093-8956-6ccc0dbe3cb4 service nova] Creating event network-changed:40420387-41a5-4e65-b209-88e109f9d32e for instance 5aef7e3a-316c-4347-ae40-5370582a017b on hv-cinder-75671 Aug 24 14:38:32.513203 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b41ac62b-0541-4e54-9d89-1bd6a4d560af req-08984413-afef-4093-8956-6ccc0dbe3cb4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 14:38:32.513695 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b41ac62b-0541-4e54-9d89-1bd6a4d560af req-08984413-afef-4093-8956-6ccc0dbe3cb4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 14:38:32.514776 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.515171 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.515760 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.516513 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.516971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.517388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.527861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.compute.rpcapi [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 14:38:32.530014 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] Releasing lock "compute-rpcapi-router" {{(pid=132892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 14:38:32.545604 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-37a94f83-c191-4a55-8d96-87b0abc8ff9e None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075152 Aug 24 14:38:32.546374 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 37/69] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:32.632309 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-932cda5c-eb0d-478b-b962-60b5cbd7bed4 req-b49c57c0-d5d8-4321-80aa-6fc5a3777367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687c842a-2354-49c5-9c12-165babf4a0d6", "tag": "e937f76f-4ef7-4572-b805-b6918a000637"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:32.646088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-932cda5c-eb0d-478b-b962-60b5cbd7bed4 req-b49c57c0-d5d8-4321-80aa-6fc5a3777367 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.646770 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-932cda5c-eb0d-478b-b962-60b5cbd7bed4 req-b49c57c0-d5d8-4321-80aa-6fc5a3777367 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.647326 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-932cda5c-eb0d-478b-b962-60b5cbd7bed4 req-b49c57c0-d5d8-4321-80aa-6fc5a3777367 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.660347 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-932cda5c-eb0d-478b-b962-60b5cbd7bed4 req-b49c57c0-d5d8-4321-80aa-6fc5a3777367 service nova] Creating event network-changed:e937f76f-4ef7-4572-b805-b6918a000637 for instance 687c842a-2354-49c5-9c12-165babf4a0d6 on hv-cinder-75671 Aug 24 14:38:32.665387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-932cda5c-eb0d-478b-b962-60b5cbd7bed4 req-b49c57c0-d5d8-4321-80aa-6fc5a3777367 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038389 Aug 24 14:38:32.666056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 33/70] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:38:32.755140 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:32.760555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:32.763308 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.763676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.764109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.764810 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.765263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.765690 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.981240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=6 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:32.986297 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:32.987023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:32.994279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.995010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.995390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:32.996107 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:32.996740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:32.997019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:33.007278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.017058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cb2d3acb-b94e-40ea-a73c-231c9be436bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.267047 Aug 24 14:38:33.017058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 38/71] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:32 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:33.204780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.213413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c0f7f3fb-c9c8-4c49-bde0-61b1ee0b4be3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.233342 Aug 24 14:38:33.225992 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 34/72] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:32 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:33.334575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:33.355230 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:33.373163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:33.373976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:33.374478 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:33.375247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:33.375894 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:33.376619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:33.402995 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:33.403897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:33.411317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:33.421176 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:33.421176 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:33.421176 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:33.421176 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:33.421608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:33.435227 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:33.568279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.570664 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=93 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:33.576741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e4506624-fc44-4c21-b091-5a966107ef9d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.251987 Aug 24 14:38:33.577583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 39/73] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:33 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:33.601024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.609682 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.611887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:33.613109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-744c85c9-d9de-474e-8c42-dbd46def4b60 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.214439 Aug 24 14:38:33.613704 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 35/74] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:33 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:34.037964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:34.038611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:34.044768 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.045256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.045814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.046537 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.053592 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.053592 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.182469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:34.190438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-91d1d918-754f-4537-805c-073deede6331 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.156814 Aug 24 14:38:34.191894 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 40/75] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:34 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:34.241643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:34.242483 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:34.249385 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.249893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.250328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.251014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.251494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.251912 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.390987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:34.399180 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2df90da2-76b2-49e5-9a0d-48083a4451a9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.162078 Aug 24 14:38:34.399754 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 36/76] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:34 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:34.601159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:34.601714 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:34.608325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.608816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.609500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.610218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.610718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.611137 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.635940 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:34.637896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:34.644208 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.646896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.646896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.646896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.646896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.647374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.844630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:34.853499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2d2fae15-6571-482f-83f0-330cd5aa719d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.257306 Aug 24 14:38:34.854062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 41/77] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:34 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:34.858636 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-2f4b930d-6d88-4f29-8f25-9ce53fb7d233 req-cf85a051-55ad-4aa4-9fb6-404b267c450f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c66552-d72b-47db-b7ae-2d2fe02ef11a", "tag": "8b158e3e-7307-4f1b-b356-8819d9bf1e42"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:34.860616 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:34.869621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-2f4b930d-6d88-4f29-8f25-9ce53fb7d233 req-cf85a051-55ad-4aa4-9fb6-404b267c450f service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:34.870138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-2f4b930d-6d88-4f29-8f25-9ce53fb7d233 req-cf85a051-55ad-4aa4-9fb6-404b267c450f service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:34.870588 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-2f4b930d-6d88-4f29-8f25-9ce53fb7d233 req-cf85a051-55ad-4aa4-9fb6-404b267c450f service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:34.874323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:34.877260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:34.879125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ae03b7e6-952c-4985-9644-d6fbd77b2f18 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.246821 Aug 24 14:38:34.881878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 37/78] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:34 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:34.883754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-2f4b930d-6d88-4f29-8f25-9ce53fb7d233 req-cf85a051-55ad-4aa4-9fb6-404b267c450f service nova] Creating event network-changed:8b158e3e-7307-4f1b-b356-8819d9bf1e42 for instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a on hv-cinder-75671 Aug 24 14:38:34.889249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-2f4b930d-6d88-4f29-8f25-9ce53fb7d233 req-cf85a051-55ad-4aa4-9fb6-404b267c450f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034060 Aug 24 14:38:34.889860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 42/79] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:38:35.213390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:35.214138 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:35.220216 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.220704 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.221137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.222019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.222544 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.222983 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.369694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:35.377320 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3de946ae-96f9-4e62-bf18-37590cb34238 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.167857 Aug 24 14:38:35.377902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 38/80] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:35 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:35.421009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:35.421704 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:35.428244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.428725 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.429165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.429884 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.430341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.430767 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.566829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:35.574499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d493113c-b15e-46be-b136-76e215fb1729 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.157759 Aug 24 14:38:35.575101 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 43/81] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:35 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:35.875840 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:35.876317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:35.882338 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.882824 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.883257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.883960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.884395 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.884823 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.903031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:35.903775 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:35.910718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.911196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.911625 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:35.912312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:35.912756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:35.913173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.091437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.100132 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.101041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-fa349fa6-c920-4104-9175-780f8d68557d tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.229080 Aug 24 14:38:36.101647 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 39/82] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:35 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:36.112597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.114190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.115448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2ae7a51e-c74c-4e38-9b30-8e5ae4b1533b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.216448 Aug 24 14:38:36.116011 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 44/83] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:35 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:36.398362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:36.398869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:36.404844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:36.405325 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:36.405771 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.406469 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:36.406917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:36.407342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.541361 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.549272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-52bdb603-c133-4460-9f9e-3c08501ff53d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.155408 Aug 24 14:38:36.549941 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 40/84] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:36 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:36.595260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:36.595959 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:36.598596 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=28 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:36.603461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:36.603946 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:36.604376 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.605091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:36.605541 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:36.605988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:36.922309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:36.930384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-71c182d3-930a-4707-92b4-4c7fc0e40680 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.338897 Aug 24 14:38:36.930972 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 45/85] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:36 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:37.122612 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:37.123249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:37.130205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.130724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.131223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.131964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.132415 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.132836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.139507 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:37.140363 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:37.148736 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.149342 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.149825 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.150531 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.150980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.151406 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.349432 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.353156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.357413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dfd2662e-d011-4d60-9bd5-c97f17c1dc22 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.238653 Aug 24 14:38:37.358035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 41/86] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:37 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:37.362125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.363656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.364752 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-76b51625-5c55-4d86-b8e9-7e9f32389049 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.229837 Aug 24 14:38:37.365298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 46/87] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:37 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:37.570909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:37.571545 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:37.577449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.577964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.578394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.579071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.579518 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.579932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.713834 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:37.722016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5359d436-974f-448c-a3a8-80aaabde9736 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.154868 Aug 24 14:38:37.722952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 42/88] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:37 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:37.951323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:37.951860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:37.958446 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.958927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.959356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:37.960050 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:37.960498 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:37.960928 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.104924 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.113688 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4480fbc5-245f-4776-9223-62163851416e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.165968 Aug 24 14:38:38.114348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 47/89] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:37 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:38.378964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:38.379576 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:38.385920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.386412 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.386842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.387550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.388004 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.388459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.389955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:38.390643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:38.397243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.397727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.398191 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.398896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.399341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.400802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.603719 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.610916 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.611837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f51050b6-a3f2-4c57-9341-274ab5390a11 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.236736 Aug 24 14:38:38.612437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 43/90] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:38 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:38.619576 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.621109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.622408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-12984f9c-c63e-4831-98d9-ebcb25bfecb3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.237985 Aug 24 14:38:38.622962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 48/91] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:38 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:38.754656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:38.755830 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:38.766848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.767585 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.768348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.770194 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:38.771217 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:38.771978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:38.945152 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:38.953164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e4bf6350-9dde-4170-981a-6a248708509c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.205995 Aug 24 14:38:38.953973 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 44/92] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:38 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:39.136389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:39.137010 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:39.143211 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.144506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.144976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.145679 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.146163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.146590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.305018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:39.326224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-84cd5f53-d390-49aa-ae3c-284a355a95b8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.189129 Aug 24 14:38:39.326224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 49/93] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:39 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:39.635608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:39.635608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:39.640457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.640946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.641373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.642212 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.642659 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.643079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.651855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:39.652886 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:39.662879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.663424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.664023 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.665019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.665612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.666200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.877173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:39.886349 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1951151d-41fa-4119-bc14-8929daeee12e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.256613 Aug 24 14:38:39.887757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 45/94] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:39 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:39.899378 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:39.908492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:39.910604 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:39.911832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fc4a668f-ab88-41ce-b8af-0503c6735419 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.267714 Aug 24 14:38:39.912364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 50/95] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:39 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:39.976502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:39.977902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:39.985042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.985658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.986166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:39.986910 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:39.987618 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:39.988044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.137312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:40.145837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-20ec3a4a-fad1-47ea-9425-3ad283b77fdb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.173801 Aug 24 14:38:40.146452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 46/96] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:39 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:40.359685 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:40.360845 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:40.368163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.374454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.374454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.374454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.374454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.374956 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.528890 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:40.539355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-764ca7b7-eadd-4d34-ae31-236070b989ac tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.182107 Aug 24 14:38:40.539355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 51/97] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:40 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:40.908490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:40.909217 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:40.916337 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.916820 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.917403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.918157 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.918606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.919057 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.935727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:40.936548 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:40.943245 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.943734 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.944159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:40.944854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:40.945298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:40.945711 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.134920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.141007 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.148842 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.150323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.151500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dc9ace3f-e27b-4ec2-b5f9-2afbd461b8e8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.219590 Aug 24 14:38:41.152354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 52/98] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:40 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:41.185989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:41.186419 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:41.196732 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e6711f8f-bb89-4914-87f8-03e4d39c7e4a tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.288853 Aug 24 14:38:41.196732 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 47/99] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:40 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:41.197159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:41.197621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:41.198100 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.198812 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:41.199257 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:41.199675 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.368574 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.378913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cb7f5bb7-fb02-467c-81d1-6b10f310768c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.204203 Aug 24 14:38:41.379422 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 53/100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:41 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:41.564116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:41.565398 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:41.574432 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:41.574977 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:41.575453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.576417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:41.576918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:41.577500 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:41.731874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:41.743990 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-040ccafe-3485-40eb-bb8b-86ffb7b4510b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.186596 Aug 24 14:38:41.744822 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 48/101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:41 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:42.177582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:42.178287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:42.185616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.186523 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.187218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.188020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.188472 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.188907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.223029 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:42.223587 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:42.233720 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.234990 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.235710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.236757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.237954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.238570 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.443930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:42.452338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:42.453871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:42.455009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-130295a2-a2d3-4006-9381-a841b5615837 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.283358 Aug 24 14:38:42.455582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 54/102] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:42 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:42.457729 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:42.460339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:42.460955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:42.467235 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.467722 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.468340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.469039 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.469496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.470415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.472459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-73f4757d-8a69-4d0d-b8b2-69191ded6189 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.253274 Aug 24 14:38:42.473772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 49/103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:42 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:42.527658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=8 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:42.622151 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:42.632149 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-637c1ceb-65ca-4d69-99da-f0e5b7b4c499 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.175476 Aug 24 14:38:42.632731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 55/104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:42 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:42.766497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:42.767058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:42.774381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.774871 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.775308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.776007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:42.776459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:42.776902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:42.933049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:42.941707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-02594093-f2ea-453c-beef-ce0b1e183de9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.179372 Aug 24 14:38:42.942510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 50/105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:42 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:43.505020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:43.506110 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:43.511421 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:43.511593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:43.523886 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.524739 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.525516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.528620 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.529490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.530302 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.531714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.532633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.534859 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:43.535927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:43.537033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:43.544223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.406543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:44.413245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:44.425073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:44.428417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-df76f738-b33d-455e-b6e2-e7611f36f9dc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.935977 Aug 24 14:38:44.428603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:44.429466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 51/106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:43 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:44.430917 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-653dabf7-9f27-46e7-87f3-511342adfe7c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.941236 Aug 24 14:38:44.446116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:44.446116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:44.446436 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 56/107] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:43 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:44.460039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.460910 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.461694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.463407 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.463845 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:44.464499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.465333 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.465456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:44.474792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:44.477652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.478197 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.481218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.482043 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:44.482511 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:44.482931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:44.486149 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:44.704250 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:44.712703 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:44.714788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3550a551-4721-40ac-ab1b-f513d66d01a4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.283289 Aug 24 14:38:44.715645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 52/108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:44 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:44.722092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-18a16c9e-4da5-43f6-92e4-ced3a6d60008 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.275738 Aug 24 14:38:44.722848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 57/109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:44 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:45.453881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:45.454824 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:45.465628 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.466421 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.467088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.468171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.468858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.472928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.482160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:45.482756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:45.494605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.495104 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.495540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.496292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.496747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.497310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.790862 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:45.806680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-fa062a46-5caa-4e98-b4fd-8a62992a6255 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.358671 Aug 24 14:38:45.807521 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 53/110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:45 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:45.810834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:45.815195 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:45.817224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:45.830429 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:45.834364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.834364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.834364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.834748 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:45.834903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.834903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.835135 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.836000 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3ae90d3c-ecfa-4df9-8540-8b024777cbc8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.362200 Aug 24 14:38:45.837065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 58/111] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:45 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:45.845611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:45.846827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:45.858169 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.859463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.860356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:45.871789 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:45.871789 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:45.871789 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.113976 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:46.122639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e2f5ac5d-74c9-4fcd-9993-28f1a1d6798f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.313608 Aug 24 14:38:46.123221 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 54/112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:45 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:46.150566 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:46.164125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39e7b36f-a809-4cc2-bb43-df513f6c1ec4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.324939 Aug 24 14:38:46.166104 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 59/113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:45 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:46.839516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:46.840439 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:46.848137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.848664 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.849155 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.850015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.850528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.850996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.872979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:46.874276 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:46.890444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.890444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.890444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:46.890444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:46.891003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:46.891003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:47.156134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:47.165238 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c2c52d96-6135-40b6-a3c3-f3b766eba64e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.329967 Aug 24 14:38:47.165860 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 55/114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:46 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:47.171598 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:47.176457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:47.176656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:47.180163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:47.180906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:47.181495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:47.182830 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:47.183946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:47.184688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:47.191013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:47.195696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:47.198206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-23979d41-dee1-4e9b-b354-39eb8b0f25b5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.331609 Aug 24 14:38:47.202037 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 60/115] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:46 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:47.226316 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:47.227131 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:47.238831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:47.239809 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:47.240595 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:47.242137 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:47.243012 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:47.243750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:47.445489 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:47.460948 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0f7f12d4-7b11-468d-b294-f29e34888a2c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.293564 Aug 24 14:38:47.462145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 56/116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:47 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:47.477829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:47.489379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-69dcdf43-d235-4fdf-b463-f2dbbead981a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.270643 Aug 24 14:38:47.490236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 61/117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:47 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:48.219065 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:48.219680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:48.227094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.227795 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.228285 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.229040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.229571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.230075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.245195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:48.246231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:48.257621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.258448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.259148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.260451 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.261208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.261986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.495330 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.501607 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.504259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.506292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-30b2327b-66fd-4545-95c5-40e63920f5c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.267762 Aug 24 14:38:48.507682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 62/118] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:48 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:48.511076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.513040 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:48.513637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:48.520910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.521391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.521848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.522638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.523293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.523963 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.533180 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-73805bec-4081-4e72-9df0-61b3a2e1c2fc tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.317565 Aug 24 14:38:48.536909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 57/119] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:48 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:48.546139 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:48.547379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:48.560446 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.561693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.562259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.563410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:48.564224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:48.564784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:48.729879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.745083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bbfef94d-0b41-4c40-b71a-80de4fdf7d7a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.235566 Aug 24 14:38:48.746185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 63/120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:48 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:48.776351 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:48.785426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1d2cd9f3-9f30-41d9-8449-17620f9ba984 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.246883 Aug 24 14:38:48.786063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 58/121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:48 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:49.547098 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:49.550922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:49.557459 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.558173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.558833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.559913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.560641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.561279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.570695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:49.571453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:49.577884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.579528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.579528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.579528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.579981 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.580381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.832570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:49.845570 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:49.846340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:49.848708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:49.849989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-076cfbc5-d314-474c-a89f-81dc035ffd90 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.308897 Aug 24 14:38:49.851200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 64/122] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:49 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:49.855243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:49.855850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:49.857094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3013efb9-ec4c-41f5-9e7f-ec50aa8c4a29 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.291827 Aug 24 14:38:49.858435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 59/123] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:49 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:49.865009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:49.866076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:49.874859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.876079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.877059 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.878841 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.879465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.879635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.880442 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.880557 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.881240 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:49.882840 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:49.883609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:49.884296 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:50.160818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:50.161186 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:50.163692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9c372660-559b-451d-9dd3-ce3e938aeb92 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.311706 Aug 24 14:38:50.171920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2af398d2-1b32-4e2d-a211-a37eb12f939d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.310480 Aug 24 14:38:50.172533 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 60/124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:49 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:50.179078 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 65/125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:49 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:50.877844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:50.878461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:50.884888 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:50.885377 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:50.885839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:50.886559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:50.887000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:50.887424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:50.890833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:50.892009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:50.898517 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:50.898988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:50.899419 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:50.900121 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:50.900568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:50.900988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.108899 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.119068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-250f2652-a1df-49c5-b5bc-88bbdc565bf4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.232922 Aug 24 14:38:51.119687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 66/126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:50 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:51.122167 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.140510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.144559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.146852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a18e788f-ad65-473a-a87e-5319321fabfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.272772 Aug 24 14:38:51.147894 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 61/127] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:50 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:51.193783 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:51.194709 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:51.196603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:51.197240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:51.203397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.204139 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.204585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.205300 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.206184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.210399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.210542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.210631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.210713 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.210713 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:51.210713 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:51.210713 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:51.525803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.534719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eb8fd9a5-59f3-4b30-be61-c9e0aaaad0eb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.344206 Aug 24 14:38:51.535329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 67/128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:51 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:51.536597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:51.544609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-71644d0c-472d-4539-9b9a-7bda9cd8585d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.354204 Aug 24 14:38:51.545191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 62/129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:51 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:52.144135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:52.145170 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:52.148155 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:52.154197 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.154688 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.156473 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.156473 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.156473 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.156869 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.175935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:52.176837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:52.185207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.185207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.185568 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.186511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.186961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.187377 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.387459 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.399042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.400215 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ef559bbd-9fb3-417e-9029-6b1788132b62 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.262579 Aug 24 14:38:52.401173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 68/130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:52 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:52.408260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.411616 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.413508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-6643633c-79e5-46b8-9a8d-893e98df2b1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.245050 Aug 24 14:38:52.414129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 63/131] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:52 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:52.557189 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:52.557851 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:52.565808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.566313 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.566946 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.568092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.568887 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.569650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.576125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:52.576879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:52.584284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.584772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.585205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.586032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:52.586496 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:52.586920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:52.802747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.814588 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5fcf2d0a-3ca4-4a9b-8518-8d397b23cbb2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.261690 Aug 24 14:38:52.816710 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 69/132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:52 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:52.819381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:52.828805 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b49d4668-4db9-4696-830b-5f5fb4ca990d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.257845 Aug 24 14:38:52.830184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 64/133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:52 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:53.424786 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.425696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:53.432054 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.433168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.433168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.433643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.434125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.434538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.447897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.448969 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:53.460519 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.461316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.462070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.463416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.464552 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.465034 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.674196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:53.684288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3d7c17e4-9211-43d9-9116-83c808adc621 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.263789 Aug 24 14:38:53.684942 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 70/134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:53.700062 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:53.713571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:53.716408 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:53.717980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7311d052-d444-4c8e-a3a1-8df80ce364ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.274125 Aug 24 14:38:53.719001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 65/135] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:53.837645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.838191 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:53.844750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.845268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.845700 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.847005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.847803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.848258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.854107 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:53.854987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:53.862654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.862654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.862654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:53.864167 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:53.864636 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:53.865057 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.075926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:54.092365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eabc1b34-5d5c-4c9d-b219-c77bf885729b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.256547 Aug 24 14:38:54.092485 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:54.092581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 71/136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:54.107805 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d2029030-582a-4ba1-91b7-05d5c567c702 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.258160 Aug 24 14:38:54.109074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 66/137] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:53 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:54.707402 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:54.708116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:54.714418 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:54.714907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:54.715340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.716042 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:54.716497 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:54.716948 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.750766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:54.751378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:54.758032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:54.759286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:54.759286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.759644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:54.760122 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:54.760744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:54.946136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:54.954467 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6a57810e-4393-481c-897c-a4def9a65bad tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.251584 Aug 24 14:38:54.955093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 72/138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:54 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:54.978913 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:54.990859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:54.993467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:54.995395 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2942e7fe-aa4e-4e1b-96fd-d5810d8d38b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.248338 Aug 24 14:38:54.996299 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 67/139] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:54 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:38:55.118470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:55.119449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:55.126458 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.130560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.130560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.130560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.130560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.131154 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.153313 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:55.153313 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:55.157701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.159406 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.160366 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.161574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.162385 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.163119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.391479 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:55.394974 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:55.397926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:55.398912 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:55.406915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d6cd9de1-4fff-464d-9e2c-c491223a41ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.266345 Aug 24 14:38:55.406915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 68/140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:55 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:55.407172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aef2cce2-bffd-4793-94a1-dfd8e8614da4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.292048 Aug 24 14:38:55.407172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 73/141] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:55 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:55.981361 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:55.982300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:55.993280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.993779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.994215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:55.994904 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:55.995360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:55.996079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.022115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:56.023188 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:56.033120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.035113 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.035535 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.036280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.036752 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.037241 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.342759 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.352464 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3ad1717b-e5e9-42bc-86a8-03ed208f970e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.377249 Aug 24 14:38:56.353868 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 69/142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:55 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:56.430322 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:56.431937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:56.447325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.451577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.452578 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.454497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.457134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.458104 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.465528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.471821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.475272 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.477983 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3f0bc9d4-a0d0-4302-afed-f35022461e41 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.462904 Aug 24 14:38:56.479160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 74/143] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:56 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:56.486507 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:56.488770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:56.505623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.506946 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.507928 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.509287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:56.510325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:56.511244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:56.742097 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.755743 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e8f0f3d3-7454-4526-ada5-1281aeac3b9b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.331454 Aug 24 14:38:56.757122 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 70/144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:56 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:56.765633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:56.782621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-57660bda-390d-4f57-a947-19475c749869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.301134 Aug 24 14:38:56.783873 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 75/145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:56 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:57.384108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:57.385991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:57.396348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.397106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.397876 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.399021 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.403120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.403120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.513190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:57.521581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:57.544450 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.545267 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.546932 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.550301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.551093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.552044 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.689332 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:57.726924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c80548e1-1ac1-4e3b-a346-d76a7e8c8c23 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.346614 Aug 24 14:38:57.728448 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 71/146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:57 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:38:57.795663 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:57.801434 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:57.809102 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.810261 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.811528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.813005 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.813833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:57.815205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.817203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.830369 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:57.833928 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:57.835409 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5427dec7-da07-4fe5-9a82-aaa13efc4d0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.332770 Aug 24 14:38:57.836053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 76/147] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:57 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:57.843484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:57.844132 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:57.852198 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.852694 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.853121 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:57.854642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:57.855469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:57.856244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:58.129423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:58.134403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:58.142087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ae181240-4c5a-4d84-83ff-1352d9d9c0ba tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.352276 Aug 24 14:38:58.163045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 72/148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:57 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:58.170794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e25100b9-2656-4272-a928-d9efb627158c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.332856 Aug 24 14:38:58.171943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 77/149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:57 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:58.492132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-b0189171-1630-416f-bb25-7e701d2a0c36 req-7553844d-cc21-46fc-927a-c2974895ac80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c668d6f9-dc62-4c9c-800a-52cad818260f", "name": "network-vif-plugged", "status": "completed", "tag": "641a28bc-5369-473e-8531-fd1a1fee6294"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:38:58.503733 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-b0189171-1630-416f-bb25-7e701d2a0c36 req-7553844d-cc21-46fc-927a-c2974895ac80 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:58.504515 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-b0189171-1630-416f-bb25-7e701d2a0c36 req-7553844d-cc21-46fc-927a-c2974895ac80 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:58.505336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-b0189171-1630-416f-bb25-7e701d2a0c36 req-7553844d-cc21-46fc-927a-c2974895ac80 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:58.524449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-b0189171-1630-416f-bb25-7e701d2a0c36 req-7553844d-cc21-46fc-927a-c2974895ac80 service nova] Creating event network-vif-plugged:641a28bc-5369-473e-8531-fd1a1fee6294 for instance c668d6f9-dc62-4c9c-800a-52cad818260f on hv-cinder-75671 Aug 24 14:38:58.532807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-b0189171-1630-416f-bb25-7e701d2a0c36 req-7553844d-cc21-46fc-927a-c2974895ac80 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124055 Aug 24 14:38:58.534327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 73/150] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:38:58.775764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:58.776608 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:58.784453 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:58.785280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:58.786018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:58.786948 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:58.787405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:58.787976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:58.879955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:58.881292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:58.891388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:58.892382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:58.893784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:58.895056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:58.895696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:58.896300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:59.067312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:59.083323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-491c70ce-ef0f-455e-ab8e-b19f25fc601e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.311068 Aug 24 14:38:59.098591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 78/151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:58 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:38:59.180157 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:59.181230 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:59.184869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:59.200761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:59.200761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:38:59.203409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f398fdf4-eef8-464b-a041-5a0439862fd7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.331581 Aug 24 14:38:59.205150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 74/152] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:38:58 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:38:59.210269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:59.211027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:59.213319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:59.214258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:59.217066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:59.224723 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:59.227152 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:38:59.228529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:38:59.245037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:59.251379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:59.251718 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:38:59.255302 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:38:59.256466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:38:59.257086 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:00.247164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:00.259316 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a862215b-0510-4d3f-92ac-82ccaa3db379 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 1.082909 Aug 24 14:39:00.260725 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 79/153] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:59 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:00.287653 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:00.289690 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:00.314395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.319025 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.321229 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:00.324652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.326520 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.327159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:00.353049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:00.401680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3d47aa1e-f0db-4358-aec0-b5c1dda1bc6f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 1.194675 Aug 24 14:39:00.411472 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 75/154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:38:59 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:00.427420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:00.428555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:00.437845 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.438531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.439138 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:00.440928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:00.441720 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:00.442650 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.050898 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:01.072566 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:01.075108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b3e7b7c9-c308-4fc2-acfb-24ee81e2c4a7 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.813167 Aug 24 14:39:01.076043 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 80/155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:00 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:01.093657 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:01.096777 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:01.099685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8b489926-8a7d-4934-b0b4-d1cf0031d17b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.686616 Aug 24 14:39:01.101249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 76/156] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:00 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:01.285258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:01.285910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:01.292537 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:01.293021 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:01.293642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.294593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:01.295045 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:01.295639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.433018 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:01.434256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:01.436894 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=96 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:01.443184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:01.443679 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:01.444169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.445258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:01.445714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:01.446158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:01.519639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:01.529921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-566983bb-d7fc-4c99-a5ce-acc2bbb202fb tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.249522 Aug 24 14:39:01.530689 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 81/157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:01 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:01.620543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:01.628935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-51566bad-144b-4b73-9e81-6a0567ad5fe2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.199670 Aug 24 14:39:01.629726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 77/158] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:01 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:02.134499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:02.135227 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:02.144524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:02.144524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:02.153393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.153902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.154395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.154541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.154884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.155093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.155605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.156049 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.156749 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.157299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.159545 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.159545 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.407057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:02.414787 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:02.426051 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:02.426462 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:02.427924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5e82ff9f-b121-4b66-84fe-a0328280b22d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.298657 Aug 24 14:39:02.428643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 78/159] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:02 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:02.432999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f5615245-9af6-49ed-9db4-ec765c7972fe tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.312883 Aug 24 14:39:02.434049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-aca090b8-5415-425a-bf7f-863108ae828e req-6177ccf9-856a-4cb8-974c-db9ffec9ebcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279f90bd-61da-416d-9bd8-de6da5bd41ce", "name": "network-vif-plugged", "status": "completed", "tag": "0a890f22-afe5-4a9a-a3b8-506e89f9fe19"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:02.434646 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 82/160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:02 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:02.445878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-aca090b8-5415-425a-bf7f-863108ae828e req-6177ccf9-856a-4cb8-974c-db9ffec9ebcc service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.446622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-aca090b8-5415-425a-bf7f-863108ae828e req-6177ccf9-856a-4cb8-974c-db9ffec9ebcc service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.447302 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-aca090b8-5415-425a-bf7f-863108ae828e req-6177ccf9-856a-4cb8-974c-db9ffec9ebcc service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.460130 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-aca090b8-5415-425a-bf7f-863108ae828e req-6177ccf9-856a-4cb8-974c-db9ffec9ebcc service nova] Creating event network-vif-plugged:0a890f22-afe5-4a9a-a3b8-506e89f9fe19 for instance 279f90bd-61da-416d-9bd8-de6da5bd41ce on hv-cinder-75671 Aug 24 14:39:02.465520 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-aca090b8-5415-425a-bf7f-863108ae828e req-6177ccf9-856a-4cb8-974c-db9ffec9ebcc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035398 Aug 24 14:39:02.466175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 79/161] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:02.553613 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:02.554505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:02.561846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.565814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.565814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.565814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.565814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.566190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.651243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:02.652061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:02.660052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.660613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.661184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.661951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:02.662827 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:02.663425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:02.734510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:02.743755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f1db72d4-c255-4e39-ba51-daf0500da0b5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.194745 Aug 24 14:39:02.744732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 83/162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:02 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:02.826106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:02.835232 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d43d17bf-2513-40f3-b4ad-85fcb84c9084 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.189545 Aug 24 14:39:02.835808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 80/163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:02 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:03.451991 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:03.452593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:03.454384 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:03.455503 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:03.459978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.460460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.460889 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.464371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.464488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.464583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.464671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.464756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.464858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.464858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.464858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.464858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.705269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:03.708397 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:03.713979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:03.715965 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:03.716815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-767d10b8-db8a-4c18-8c1f-4f25350e6156 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.266162 Aug 24 14:39:03.717459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 81/164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:03 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:03.717691 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4e51ff7f-c604-4fc9-84c8-b9eb4f269af0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.269653 Aug 24 14:39:03.730827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 84/165] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:03 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:03.767036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:03.767776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:03.774059 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.774533 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.774966 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.775658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.776135 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.776532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.859059 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:03.859705 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:03.867148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.867662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.870573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.870573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:03.870573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:03.870573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:03.958089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:03.968008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d50c65bb-6b23-4f8f-86c1-763f6199d7ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.205102 Aug 24 14:39:03.968766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 82/166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:03 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:04.032190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:04.040563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aab16a1b-b387-440d-8d62-742d13fac71f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.186318 Aug 24 14:39:04.041169 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 85/167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:03 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:04.738746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:04.739264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:04.742623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:04.743472 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:04.745224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:04.745764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:04.746213 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:04.747052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:04.747634 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:04.748067 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:04.750008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:04.751660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:04.751660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:04.751660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:04.752432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:04.752961 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:04.958726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:04.963573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:04.966513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-626b6aa1-36db-43b4-a3b4-17071e6961f4 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.232449 Aug 24 14:39:04.967267 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 83/168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:04 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:04.972955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:04.974559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:04.975680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-08f8fe9f-a9cb-4a05-a486-034c296ef62e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.237069 Aug 24 14:39:04.976250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 86/169] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:04 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:04.995325 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:04.995972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:05.002458 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.002907 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.003379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:05.004015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.004467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.005174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:05.064656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:05.065621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:05.074333 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.074824 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.076583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:05.077290 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.077780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:05.078196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:05.197864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:05.210024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-fd62143e-8dec-4f2e-99cb-14ff3ac68026 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.219543 Aug 24 14:39:05.223764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 84/170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:04 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:05.266950 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:05.278803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1cbfc5dd-80b1-48d6-b132-1a3ec86b1b71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.218871 Aug 24 14:39:05.279603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 87/171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:05 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:05.991876 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:05.992673 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:05.998983 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:05.999763 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:06.000188 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:06.000669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.001075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:06.001511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:06.001805 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:06.002574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.008795 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:06.009589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:06.010199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.011353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:06.012089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:06.012676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.210850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:06.219030 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e6e5bfba-f606-49bf-a04b-45c9adfe8fbb tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.234179 Aug 24 14:39:06.219607 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 85/172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:05 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:06.239071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:06.239695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:06.245857 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:06.250294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:06.250294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.250294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:06.250294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:06.250952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.251133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:06.262719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:06.265288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:06.271408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-75a294c6-a558-4d71-8596-0f77290d6a65 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.275492 Aug 24 14:39:06.288341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 88/173] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:05 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:06.301588 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:06.302294 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:06.310333 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:06.311041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:06.311702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.312562 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:06.313405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:06.314062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:06.466263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:06.469796 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:06.474520 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-442f6899-f794-4150-bcf5-221c967183c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.240516 Aug 24 14:39:06.475106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 86/174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:06 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:06.493877 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:06.501833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9eef22b5-d8bf-426d-a84e-09f6b1ef01fc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.204952 Aug 24 14:39:06.503037 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 89/175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:06 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:07.239729 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:07.240528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:07.247418 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.247916 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.249443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.249443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.249773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.249944 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.301768 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:07.302717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:07.310297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.311515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.312057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.313047 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.313841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.314591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.333439 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:07.513539 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:07.522511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3ae28471-a145-4189-8761-84fedfbf075b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.286858 Aug 24 14:39:07.523182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 87/176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:07 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:07.527879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:07.528628 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:07.534654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.538275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.538275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.538275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.538275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.538574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.571627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:07.580699 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:07.582325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:07.584177 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-af5a0a99-6b98-4e17-8379-68215bd14829 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.290127 Aug 24 14:39:07.593922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 90/177] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:07 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:07.598034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:07.598655 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:07.604949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.605435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.605895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:07.606599 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:07.607050 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:07.607473 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:08.001240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:08.002595 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:08.002758 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-95811bf5-52fa-4d47-8298-3357b9018e8a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.422630 Aug 24 14:39:08.002758 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 88/178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:07 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:08.002910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4902e032-c9bb-4fcf-a09c-bc8e7681ee46 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.364220 Aug 24 14:39:08.002910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 91/179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:07 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:08.544144 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:08.544856 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:08.551181 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:08.551665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:08.552086 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:08.552807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:08.553252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:08.553666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:08.606802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:08.607415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:08.614971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:08.617656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:08.617656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:08.617656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:08.617656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:08.618013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:08.747080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:08.761884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a8b6b6fc-4ffb-4f98-868a-645d280a4043 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1315 microversion: 2.1 time: 0.222012 Aug 24 14:39:08.762689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 89/180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:08 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:08.800546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:08.811655 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:08.813582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:08.815202 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9fe97d39-7ff2-4619-a4d3-df081df262ce tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.212045 Aug 24 14:39:08.816087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 92/181] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:08 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:09.012614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:09.013231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:09.014088 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:09.014897 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:09.021894 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.022712 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.023303 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.023517 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.024081 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.024749 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.025585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.025708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.026427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.027042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.027669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.028170 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.286331 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:09.304987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-fef27bb4-21b2-4074-a8b7-1e16ebd2e2f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.289996 Aug 24 14:39:09.305705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 90/182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:09 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:09.315161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:09.325560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6629f720-67d4-4e07-b016-726b728b17d1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.315073 Aug 24 14:39:09.338453 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 93/183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:09 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:09.784593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:09.785306 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:09.792221 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.792789 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.793446 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.794294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.794823 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.795301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.838612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:09.841650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:09.847632 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.848132 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.848605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.849350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:09.849839 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:09.850263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:09.988132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:09.996049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-bce820e9-23bf-4464-8e58-0399a479ceba tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1501 microversion: 2.1 time: 0.216447 Aug 24 14:39:09.996626 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 91/184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:09 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:10.028103 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:10.040297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:10.041946 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:10.043192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a9377071-2ec3-4259-8879-40641ddf6e3b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.208628 Aug 24 14:39:10.044168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 94/185] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:09 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:10.328513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:10.329353 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:10.346625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:10.346625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:10.346625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:10.346625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:10.347417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:10.347417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:10.364109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:10.364541 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:10.375787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:10.376332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:10.376856 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:10.382140 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:10.382725 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:10.383227 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:10.587928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:10.600260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c9758392-a64e-450d-8c3c-77eafe0508bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.275878 Aug 24 14:39:10.601831 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 92/186] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:10 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:10.649179 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:10.657227 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d26ec9e6-f3d0-4003-94a4-6fdb2e87244e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.312663 Aug 24 14:39:10.658036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 95/187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:10 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:10.832007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-99c2199e-bb49-461b-be1c-2949b3e926a7 req-6d03af7c-066c-439a-91cb-e0de3ffe4fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c66552-d72b-47db-b7ae-2d2fe02ef11a", "name": "network-vif-plugged", "status": "completed", "tag": "8b158e3e-7307-4f1b-b356-8819d9bf1e42"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:10.860874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-99c2199e-bb49-461b-be1c-2949b3e926a7 req-6d03af7c-066c-439a-91cb-e0de3ffe4fd8 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:10.864364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-99c2199e-bb49-461b-be1c-2949b3e926a7 req-6d03af7c-066c-439a-91cb-e0de3ffe4fd8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:10.866101 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-99c2199e-bb49-461b-be1c-2949b3e926a7 req-6d03af7c-066c-439a-91cb-e0de3ffe4fd8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:10.889074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-99c2199e-bb49-461b-be1c-2949b3e926a7 req-6d03af7c-066c-439a-91cb-e0de3ffe4fd8 service nova] Creating event network-vif-plugged:8b158e3e-7307-4f1b-b356-8819d9bf1e42 for instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a on hv-cinder-75671 Aug 24 14:39:10.894842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-99c2199e-bb49-461b-be1c-2949b3e926a7 req-6d03af7c-066c-439a-91cb-e0de3ffe4fd8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067198 Aug 24 14:39:10.895891 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 93/188] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:11.077156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:11.077813 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:11.088031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:11.088917 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:11.090166 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:11.091449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:11.092400 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:11.093024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:11.235853 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:11.244895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:11.246404 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:11.247705 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7a0ac768-4a6e-4e1e-ad3e-313e77e8a90a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.183702 Aug 24 14:39:11.248253 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 96/189] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:11 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:11.621944 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:11.622625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:11.632108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:11.642319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:11.642319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:11.642319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:11.642319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:11.642776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:11.680388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:11.682078 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:11.693112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:11.693963 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:11.694718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:11.700187 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:11.700187 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:11.700187 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:11.864190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:11.882716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-68d2cc65-74e2-4808-9123-e5fc9707f44a tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.264484 Aug 24 14:39:11.885875 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 94/190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:11 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:11.962594 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:11.973313 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9803975f-fb6a-41f6-976f-729a69703ef4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.297305 Aug 24 14:39:11.974051 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 97/191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:11 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:12.271438 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:12.272036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:12.277879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:12.278369 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:12.280268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:12.280972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:12.281419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:12.281889 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:12.423393 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:12.433048 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:12.434616 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:12.435927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3dd18f59-98d4-4978-a947-5e8719e8c9db tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.169089 Aug 24 14:39:12.436489 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 95/192] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:12 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:12.924831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:12.926108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:12.933021 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:12.933509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:12.933978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:12.934858 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:12.935343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:12.935827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.008525 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:13.009151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:13.015234 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:13.015720 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:13.016156 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.017029 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:13.017740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:13.018222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.129660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:13.140769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-10746ef3-e7de-4c64-9709-b1c4468c9b15 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.220486 Aug 24 14:39:13.141579 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 98/193] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:12 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:13.154066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5da9413-535d-4cfe-93bf-b3633eb8bc2d"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:13.157095 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:13.165821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:13.166567 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:13.167140 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.167987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:13.168759 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:13.169322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.198163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:13.206917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-520834b4-6427-4d42-9ac3-995663882799 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.202234 Aug 24 14:39:13.207531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 96/194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:13 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:13.460837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:13.461521 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:13.467452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:13.467940 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:13.468371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.469063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:13.469517 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:13.469967 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:13.610309 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:13.619572 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:13.621060 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:13.626044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8b213a98-97f1-478d-8563-c1c146165ad8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.165788 Aug 24 14:39:13.626044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 97/195] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:13 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:14.163540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:14.164363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:14.170991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.171717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.171877 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.172662 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.173268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.174163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.311035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:14.319733 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ba8e433e-b26b-4928-9b4e-fe996d667c5f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.160022 Aug 24 14:39:14.320313 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 98/196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:14 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:14.324854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:14.328333 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:14.331803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.332289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.333134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.333863 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.334323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.334748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.475796 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:14.485167 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9ff6e573-63a7-4c1f-82ea-f802286dac30 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.162529 Aug 24 14:39:14.485167 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 99/197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:14 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:14.657304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:14.658700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:14.665131 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.665978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.666575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.667246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:14.667692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:14.668105 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:14.805972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:14.815340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:14.816835 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:14.817952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b06694d7-0509-45fd-8b6c-dcaf67f579ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.165028 Aug 24 14:39:14.818664 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 100/198] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:14 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:15.343497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:15.344182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:15.351249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.351734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.352169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.352865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.353381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.353723 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.492274 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:15.500047 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3ae41917-96e3-4bb2-adb2-313513a348bc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.160460 Aug 24 14:39:15.500626 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 101/199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:15 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:15.519094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:15.519699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:15.525523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.526044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.526476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.527162 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.527640 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.528059 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.658891 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:15.666481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-427e8b61-8728-45a1-82c3-2659f77dc1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.151840 Aug 24 14:39:15.667040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 102/200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:15 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:15.840422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:15.841060 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:15.847829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.848350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.848781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.849466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:15.849953 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:15.850375 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:15.991987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:16.001132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:16.003635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:16.004812 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9973f4fa-a174-4122-b5be-c8493f3ed202 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.168498 Aug 24 14:39:16.005617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 103/201] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:15 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:16.520845 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:16.521554 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:16.527692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:16.528170 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:16.528594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:16.529271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:16.529714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:16.530418 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:16.535544 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:16.668816 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:16.677191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-636ace89-7bc1-4197-8e7c-10cca5f4303b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.161000 Aug 24 14:39:16.678006 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 104/202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:16 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:16.688127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:16.688646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:16.694992 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:16.695472 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:16.695919 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:16.696598 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:16.697039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:16.697453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:16.829589 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:16.837350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-241761c4-afa1-423d-bb9a-5082c06bf935 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.152947 Aug 24 14:39:16.837936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 105/203] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:16 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:17.028254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:17.028861 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:17.035360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.035842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.036266 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.037166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.037786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.038203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.215328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:17.224294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:17.225802 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:17.226898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5b240476-7369-4e73-8331-1e3a2b61d0b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.202458 Aug 24 14:39:17.227456 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 106/204] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:17 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:17.700209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:17.700942 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:17.707858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.708932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.715879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.715879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.715879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.715879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.858446 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:17.866555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0b9df300-df56-4a50-ae96-6dda6cd7cf59 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.170207 Aug 24 14:39:17.867170 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 107/205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:17 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:17.871685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:17.872288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:17.878387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.878925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.879424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:17.880134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:17.880583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:17.880999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:18.011981 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:18.020121 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-acd475e2-dcb2-41ab-abba-7f842c93388a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.151910 Aug 24 14:39:18.020791 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 108/206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:17 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:18.249664 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:18.250293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:18.257228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:18.257645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:18.258110 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:18.258800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:18.259250 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:18.259667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:18.416276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:18.425121 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:18.426637 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:18.427771 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-aab5d27f-0cd6-4c14-8bc4-443a1fc23cff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.181993 Aug 24 14:39:18.428331 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 109/207] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:18 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:18.887623 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:18.888264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:18.894968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:18.895466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:18.895903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:18.896590 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:18.897044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:18.897464 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.034439 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:19.042935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5e4870cb-1257-4976-9c8d-732f58f59fd1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.159281 Aug 24 14:39:19.043509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 110/208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:18 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:19.047931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:19.048792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:19.054602 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.055076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.055501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.056269 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.056714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.057129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.275996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:19.285815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b4cc8b02-699a-4e9e-9596-5e02b8f11196 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.241292 Aug 24 14:39:19.286605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 111/209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:19 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:19.450567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:19.451467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:19.457580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.458159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.458620 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.459311 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.459766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.460193 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.638150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:19.647575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:19.649071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:19.653099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f42befc4-c64e-4169-a8c5-b9c4946a0464 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.203807 Aug 24 14:39:19.653099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 112/210] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:19 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:19.655268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-5c793497-f0aa-4402-8d30-9e1d0bb6dfb3 req-c35e62c3-3296-420f-a2e4-43cb8584b9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687c842a-2354-49c5-9c12-165babf4a0d6", "name": "network-vif-plugged", "status": "completed", "tag": "e937f76f-4ef7-4572-b805-b6918a000637"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:19.665186 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5c793497-f0aa-4402-8d30-9e1d0bb6dfb3 req-c35e62c3-3296-420f-a2e4-43cb8584b9ca service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:19.665604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5c793497-f0aa-4402-8d30-9e1d0bb6dfb3 req-c35e62c3-3296-420f-a2e4-43cb8584b9ca service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:19.666062 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5c793497-f0aa-4402-8d30-9e1d0bb6dfb3 req-c35e62c3-3296-420f-a2e4-43cb8584b9ca service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:19.678642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-5c793497-f0aa-4402-8d30-9e1d0bb6dfb3 req-c35e62c3-3296-420f-a2e4-43cb8584b9ca service nova] Creating event network-vif-plugged:e937f76f-4ef7-4572-b805-b6918a000637 for instance 687c842a-2354-49c5-9c12-165babf4a0d6 on hv-cinder-75671 Aug 24 14:39:19.683699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-5c793497-f0aa-4402-8d30-9e1d0bb6dfb3 req-c35e62c3-3296-420f-a2e4-43cb8584b9ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031626 Aug 24 14:39:19.684369 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 113/211] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:20.065562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:20.066341 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:20.072780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:20.073330 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:20.073844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:20.074576 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:20.075062 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:20.075686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:20.220097 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:20.228396 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-bf48f57c-b35a-45eb-83d4-598ffca8fc29 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.168157 Aug 24 14:39:20.228977 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 114/212] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:20 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:20.306908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:20.307702 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:20.314082 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:20.314576 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:20.315085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:20.315804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:20.316260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:20.316685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:20.461643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:20.471999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-959829ab-e193-4297-82f1-3a9a791e4456 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.168848 Aug 24 14:39:20.472621 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 115/213] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:20 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:20.677939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:20.678807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:20.685821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:20.686296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:20.687984 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:20.687984 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:20.688213 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:20.688706 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:20.822124 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:20.831236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:20.832769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:20.833905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1b2cd109-e858-46f1-8d8b-6984d9284c44 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.162969 Aug 24 14:39:20.834468 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 116/214] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:20 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:21.250532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:21.251551 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:21.273970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.276864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.280848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:21.281496 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.282003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.283318 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:21.571487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:21.583377 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-754a1d32-0e08-4568-9f92-70e7ffc032d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.336878 Aug 24 14:39:21.596814 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 117/215] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:21 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:21.604096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:21.604929 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:21.615145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.615647 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.616079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:21.616967 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.617606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.619768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:21.907870 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:21.916638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cb542e97-ebd9-437c-b186-cb880a227896 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.318246 Aug 24 14:39:21.917228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 118/216] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:21 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:21.928032 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-98b5e460-76d8-47d4-ae4c-fd9f35f6167e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "POST /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.784018 Aug 24 14:39:21.929269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 99/217] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:39:13 2022] POST /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f/os-volume_attachments => generated 194 bytes in 8787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:21.931601 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:21.932221 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:21.939355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.939994 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.940624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:21.941302 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:21.941817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:21.942233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:22.103724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:22.117337 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:22.119712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:22.120451 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9a039a49-12c0-4c13-880f-be90f1938d88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.201980 Aug 24 14:39:22.120891 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 119/218] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:21 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:22.609100 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:22.609709 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:22.612355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=64 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:22.617340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:22.617852 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:22.618332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:22.619026 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:22.620341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:22.620341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:22.796899 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:22.806569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-344e54b1-6ca8-457b-9a7a-143fa4582515 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.202531 Aug 24 14:39:22.807605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 100/219] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:22 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:22.940904 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:22.942644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:22.951554 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:22.952672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:22.953864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:22.957277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:22.958092 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:22.958736 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.127633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:23.135500 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0c652935-221d-47e5-b411-5f2b8090e81e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1322 microversion: 2.1 time: 0.199739 Aug 24 14:39:23.136268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 120/220] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:22 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:23.148286 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:23.148882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:23.160462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.160959 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.161407 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.162135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.162586 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.163007 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.345965 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:23.355110 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:23.356590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:23.357965 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ad3e6a62-4add-4819-b4fa-634b3fb70a64 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.217988 Aug 24 14:39:23.358530 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 101/221] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:23 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:23.706931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-569d5b45-c75b-4bae-a5e3-33081698347a req-ea09d6ba-2f8c-400c-b83b-5448c825e394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aef7e3a-316c-4347-ae40-5370582a017b", "name": "network-vif-plugged", "status": "completed", "tag": "40420387-41a5-4e65-b209-88e109f9d32e"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:23.720424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-569d5b45-c75b-4bae-a5e3-33081698347a req-ea09d6ba-2f8c-400c-b83b-5448c825e394 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.721501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-569d5b45-c75b-4bae-a5e3-33081698347a req-ea09d6ba-2f8c-400c-b83b-5448c825e394 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.722035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-569d5b45-c75b-4bae-a5e3-33081698347a req-ea09d6ba-2f8c-400c-b83b-5448c825e394 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.735312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-569d5b45-c75b-4bae-a5e3-33081698347a req-ea09d6ba-2f8c-400c-b83b-5448c825e394 service nova] Creating event network-vif-plugged:40420387-41a5-4e65-b209-88e109f9d32e for instance 5aef7e3a-316c-4347-ae40-5370582a017b on hv-cinder-75671 Aug 24 14:39:23.741357 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-569d5b45-c75b-4bae-a5e3-33081698347a req-ea09d6ba-2f8c-400c-b83b-5448c825e394 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042459 Aug 24 14:39:23.742019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 121/222] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:23.830322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:23.830936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:23.838841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.839509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.840115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:23.841466 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:23.842182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:23.842811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.020320 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:24.028838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-514c0fff-13b2-4ed1-bfc4-633ac356b807 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.203182 Aug 24 14:39:24.042636 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 102/223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:23 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:24.159842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:24.160530 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:24.172932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.172932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.172932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.172932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.173511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.173511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.174438 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:24.337151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:24.349125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c2c9fa80-85d9-4f0e-98c4-91a84a787994 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1517 microversion: 2.1 time: 0.193298 Aug 24 14:39:24.350127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 122/224] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:24 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:24.372062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:24.374440 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:24.383056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:24.383430 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.383706 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:24.384235 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.384952 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.386252 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.386970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.387603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.390834 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.391535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.392748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.393632 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.394116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.394537 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.432396 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lazy-loading 'flavor' on Instance uuid f9c66552-d72b-47db-b7ae-2d2fe02ef11a {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:39:24.551348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:24.560403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:24.562022 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:24.563184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7b2c2e0b-f817-4678-bd54-769e63138fb6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1405 microversion: 2.20 time: 0.185628 Aug 24 14:39:24.566351 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 123/225] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:24 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:39:24.769774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:24.848356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c1b707f8-e6d8-4e19-80b8-249cb790caaf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a/action" status: 200 len: 32 microversion: 2.1 time: 0.480280 Aug 24 14:39:24.848968 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 103/226] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:39:24 2022] POST /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a/action => generated 32 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:39:24.862644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:24.867052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:24.875189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.875906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.877100 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:24.878174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:24.878860 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:24.879438 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:25.027455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:25.035579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b29259c7-f16e-4a07-af1b-41bcbdd7bcd1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.178078 Aug 24 14:39:25.036049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 124/227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:24 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:25.057135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:25.057861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:25.066141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:25.066633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:25.067070 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:25.067770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:25.068269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:25.068693 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:25.335886 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:25.346259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c02ad208-2e29-4ed4-a4ca-cd70fd16bcf4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.294966 Aug 24 14:39:25.346888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 104/228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:25 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:25.588329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:25.588964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:25.610988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:25.612714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:25.613165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:25.614717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:25.615237 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:25.615594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.067012 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:26.067012 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:26.083575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.084075 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.084564 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.085440 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.086081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.086658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.302695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:26.328968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:26.329896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:26.332578 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8fe7f0ad-49b1-4414-8fc5-3bcce47f0076 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1597 microversion: 2.20 time: 0.747426 Aug 24 14:39:26.333814 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 125/229] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:39:25 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1597 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:39:26.385258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:26.386728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:26.402695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.404359 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.405187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.406426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.407764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.408509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.608329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:26.623885 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-76b1d8d5-4b54-45c7-8fca-9f881710780f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.563402 Aug 24 14:39:26.624677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 105/230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:26 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:26.632672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:26.633432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:26.646431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.647417 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.648037 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.648939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:26.649531 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:26.650185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:26.782728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6c43ebdd-5ca6-44f6-9347-cb491edf12f7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.152906 Aug 24 14:39:26.784655 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 106/231] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 24 14:39:26 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:39:26.788016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:26.796649 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0321aedc-9dd2-4776-b12d-9d86eef2e301 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.419530 Aug 24 14:39:26.797610 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 126/232] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:26 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:27.647829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:27.648511 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:27.668368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:27.669074 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:27.669875 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:27.670780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:27.671571 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:27.672574 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:27.820297 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:27.820907 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:27.827132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:27.828883 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:27.830355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:27.831255 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:27.832144 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:27.832816 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:27.833382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:27.947335 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:27.957671 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a730237-0bd7-4482-badf-fb709177db7e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.315073 Aug 24 14:39:27.958475 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 107/233] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:27 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:28.171209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:28.184664 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ed5c35d2-7021-4418-af44-480924cc20e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.368085 Aug 24 14:39:28.185318 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 127/234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:27 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:28.543987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-e9924fd6-4f40-4046-a0ba-c92d30c14e3f req-7a153588-520a-423a-8802-e60a3105af04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687c842a-2354-49c5-9c12-165babf4a0d6", "tag": "e937f76f-4ef7-4572-b805-b6918a000637"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:28.554624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e9924fd6-4f40-4046-a0ba-c92d30c14e3f req-7a153588-520a-423a-8802-e60a3105af04 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:28.555107 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e9924fd6-4f40-4046-a0ba-c92d30c14e3f req-7a153588-520a-423a-8802-e60a3105af04 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:28.555607 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e9924fd6-4f40-4046-a0ba-c92d30c14e3f req-7a153588-520a-423a-8802-e60a3105af04 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:28.567623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-e9924fd6-4f40-4046-a0ba-c92d30c14e3f req-7a153588-520a-423a-8802-e60a3105af04 service nova] Creating event network-changed:e937f76f-4ef7-4572-b805-b6918a000637 for instance 687c842a-2354-49c5-9c12-165babf4a0d6 on hv-cinder-75671 Aug 24 14:39:28.572863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-e9924fd6-4f40-4046-a0ba-c92d30c14e3f req-7a153588-520a-423a-8802-e60a3105af04 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033444 Aug 24 14:39:28.573460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 108/235] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:28.979493 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:28.980095 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:28.987274 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:28.987744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:28.988177 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:28.988860 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:28.989301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:28.989718 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:29.213496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:29.214476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:29.223299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:29.224277 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:29.232470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:29.232470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:29.232470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:29.232470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:29.249071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:29.266722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c0c364c5-583c-4cd4-ae5b-1a81b06fa86d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.291034 Aug 24 14:39:29.267300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 128/236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:28 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:29.568765 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:29.578835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-81c1a924-7952-4321-ba1b-b47b3f619fd9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1363 microversion: 2.1 time: 0.370890 Aug 24 14:39:29.580815 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 109/237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:29 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:30.289314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:30.302378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:30.302378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:30.302378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:30.302378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.303058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:30.303058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:30.303058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.443080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:30.451361 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d9dc113f-81a1-4df3-87a6-a5c2f6f49d3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.165538 Aug 24 14:39:30.451564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 129/238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:30 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:30.600217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:30.600829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:30.608635 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:30.609114 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:30.609539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.610765 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:30.611225 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:30.611872 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.758665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:30.768223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a43bd4c4-3c07-418c-91ca-d4214b7f4d4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1549 microversion: 2.1 time: 0.171864 Aug 24 14:39:30.768898 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 110/239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:30 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:30.796387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:30.799695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:30.805368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:30.805964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:30.806497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.807243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:30.807884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:30.809431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:30.935109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-527f79ec-8bd0-4841-9881-85469df716d9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144320 Aug 24 14:39:30.935917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 130/240] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 14:39:30 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:31.476992 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:31.477456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:31.484327 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:31.484803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:31.485955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:31.486747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:31.487196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:31.487614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:31.628818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:31.637315 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-25f9c83d-e6b1-4b98-b4f1-626fd9ae1357 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.164527 Aug 24 14:39:31.638038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 111/241] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:31 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:32.132792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-e458e5ea-b24b-49cc-bcaa-f5698b9419c4 req-2ad05763-3670-4183-b307-c34b99f74bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef7e3a-316c-4347-ae40-5370582a017b", "tag": "40420387-41a5-4e65-b209-88e109f9d32e"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:32.145466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e458e5ea-b24b-49cc-bcaa-f5698b9419c4 req-2ad05763-3670-4183-b307-c34b99f74bc2 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:32.146112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e458e5ea-b24b-49cc-bcaa-f5698b9419c4 req-2ad05763-3670-4183-b307-c34b99f74bc2 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:32.146687 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e458e5ea-b24b-49cc-bcaa-f5698b9419c4 req-2ad05763-3670-4183-b307-c34b99f74bc2 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:32.182191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-e458e5ea-b24b-49cc-bcaa-f5698b9419c4 req-2ad05763-3670-4183-b307-c34b99f74bc2 service nova] Creating event network-changed:40420387-41a5-4e65-b209-88e109f9d32e for instance 5aef7e3a-316c-4347-ae40-5370582a017b on hv-cinder-75671 Aug 24 14:39:32.190828 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-e458e5ea-b24b-49cc-bcaa-f5698b9419c4 req-2ad05763-3670-4183-b307-c34b99f74bc2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062704 Aug 24 14:39:32.191962 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 131/242] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:32.659869 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:32.660515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:32.667231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:32.667706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:32.668132 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:32.668958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:32.669403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:32.669852 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:32.842470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:32.855573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3a3380fb-77ed-4b31-a1d9-e4261808ffe1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.200074 Aug 24 14:39:32.870585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 112/243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:32 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:33.878409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:33.879116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:33.889871 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:33.890372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:33.890809 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:33.891826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:33.898499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:33.899025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:34.187785 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:34.196589 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-110d7319-580a-4ca0-a554-0f93200462c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.323688 Aug 24 14:39:34.199010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 132/244] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:33 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:35.221019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:35.222397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:35.230149 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:35.230706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:35.231208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:35.232009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:35.232784 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:35.233275 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:35.389005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:35.397156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f223906c-81b0-4316-b581-807558a86d6b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.180647 Aug 24 14:39:35.397719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 113/245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:35 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:35.603419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:35.603972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:35.611280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:35.611760 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:35.612392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:35.613267 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:35.613712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:35.614163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:35.645559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:39:35.962292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-74e228d4-7cfb-4f07-805b-48d90dec598f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 204 len: 0 microversion: 2.1 time: 0.362521 Aug 24 14:39:35.964478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 133/246] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:39:35 2022] DELETE /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:39:35.982301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:35.983586 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:35.993331 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:35.994108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:35.994672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:36.004750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:36.004750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:36.004750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:36.152127 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:36.160686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9169f314-8d8c-4079-addc-d1d3b7fbfbfd tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1553 microversion: 2.1 time: 0.186119 Aug 24 14:39:36.161458 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 114/247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:35 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:36.425726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:36.427015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:36.433485 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:36.438932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:36.438932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:36.438932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:36.438932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:36.439540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:36.633239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:36.651528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-269340ac-894a-466e-bc68-92b37e37fbf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.235774 Aug 24 14:39:36.653550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 134/248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:36 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:37.182759 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:37.183649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:37.191263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:37.191838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:37.192472 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:37.193205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:37.193663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:37.194278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:37.410943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:37.419974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ff70a1e3-4d0b-432b-b10f-abeb9bcf8be5 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1553 microversion: 2.1 time: 0.241424 Aug 24 14:39:37.420570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 115/249] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:37 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:37.691828 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:37.692864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:37.705115 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:37.706446 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:37.707421 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:37.708772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:37.709811 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:37.710697 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:37.945334 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:37.958924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7773e28b-f7b6-4236-bf42-41ac09dbea77 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.272772 Aug 24 14:39:37.960132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 135/250] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:37 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:38.452844 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:38.455899 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:38.472740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:38.474748 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:38.475711 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:38.478719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:38.479977 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:38.481254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:38.795858 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:38.811829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-84809494-bc3d-4603-b57f-fa90a22a6b8b tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1553 microversion: 2.1 time: 0.370161 Aug 24 14:39:38.815246 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 116/251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:38 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1553 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:38.981331 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:38.982122 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:38.993597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:38.995381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:38.996037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:38.997333 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:38.999160 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:38.999674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:39.358950 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:39.387047 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2549981d-8b8f-48b6-ab0a-6d2ff9c2cd38 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.404263 Aug 24 14:39:39.392098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 136/252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:38 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:39.837828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:39.838983 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:39.851978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:39.852751 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:39.853351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:39.854415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:39.855048 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:39.855631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:39.997532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-9a146f57-c34b-41bd-872e-322db1350848 req-5d5e15e2-223d-4941-9724-1be1f6935786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c668d6f9-dc62-4c9c-800a-52cad818260f", "name": "network-vif-deleted", "tag": "641a28bc-5369-473e-8531-fd1a1fee6294"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:40.010618 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-9a146f57-c34b-41bd-872e-322db1350848 req-5d5e15e2-223d-4941-9724-1be1f6935786 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:40.011573 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-9a146f57-c34b-41bd-872e-322db1350848 req-5d5e15e2-223d-4941-9724-1be1f6935786 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:40.012595 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-9a146f57-c34b-41bd-872e-322db1350848 req-5d5e15e2-223d-4941-9724-1be1f6935786 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:40.041794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:40.063994 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-00036223-dae1-4289-8d73-0621c8ff95a0 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1511 microversion: 2.1 time: 0.231747 Aug 24 14:39:40.082667 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 117/253] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:39 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:39:40.085027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-9a146f57-c34b-41bd-872e-322db1350848 req-5d5e15e2-223d-4941-9724-1be1f6935786 service nova] Creating event network-vif-deleted:641a28bc-5369-473e-8531-fd1a1fee6294 for instance c668d6f9-dc62-4c9c-800a-52cad818260f on hv-cinder-75671 Aug 24 14:39:40.097407 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-9a146f57-c34b-41bd-872e-322db1350848 req-5d5e15e2-223d-4941-9724-1be1f6935786 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106257 Aug 24 14:39:40.098976 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 137/254] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:40.420874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:40.424522 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:40.432662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:40.433161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:40.433591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:40.441525 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:40.442058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:40.442498 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:40.657563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:40.670022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a3da4f5c-503c-4a78-947f-91351fdae419 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.253128 Aug 24 14:39:40.671292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 118/255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:40 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:41.089050 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:41.090517 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:41.101581 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:41.102816 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:41.103515 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:41.104656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:41.105595 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:41.106287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:41.161870 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:41.162535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:41.163116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:41.164017 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lazy-loading 'fault' on Instance uuid c668d6f9-dc62-4c9c-800a-52cad818260f {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:39:41.171452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:41.216978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0a0a0664744f378ca4e17e914f4259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afce3a011534835893040caf18b19a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:41.229935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-03b5f14a-0ea9-455f-81c1-0146b8107282 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 200 len: 1351 microversion: 2.1 time: 0.145015 Aug 24 14:39:41.230933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 138/256] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:41 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 1351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:41.698212 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:41.699417 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:41.711590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:41.712781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:41.713828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:41.715376 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:41.716499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:41.717524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:41.928204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:41.938174 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f28604c-b617-4c2d-aedb-480c53b430d9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.248358 Aug 24 14:39:41.950646 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 119/257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:41 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:42.256508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:42.258144 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:42.266396 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:42.267466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:42.272447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:42.273570 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:42.279236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:42.279236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:42.306507 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] HTTP exception thrown: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Request method failure captured: Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f HTTP/1.1 Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfKjZOHtjfQ720FGLH3bKXsM9mn1umjpe4shxgZJWct0fy1LRwAu-19lDVoKRqtUsc4BO9ahZ-BV0i-CgfLQJ4v7g7QFGjsBdqcTflRucMCPDHZY27Y-zK7R3rE-hhqmFqQqwmRDl5GCIAg4ykocYqapZ_QuJi31-ySjcC6XtACCgQ Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 3afce3a011534835893040caf18b19a5 Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:39:42.312495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3afce3a011534835893040caf18b19a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3afce3a011534835893040caf18b19a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3afce3a011534835893040caf18b19a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3afce3a011534835893040caf18b19a5"}]}] Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 3afce3a011534835893040caf18b19a5 Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-DeleteServersTestJSON-1011178164-project Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 7b0a0a0664744f378ca4e17e914f4259 Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-DeleteServersTestJSON-1011178164-project Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.314093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'c668d6f9-dc62-4c9c-800a-52cad818260f'} Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:39:42.315233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.316553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.317683 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Returning 404 to user: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:39:42.317683 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8bc9954f-8f54-4215-8ee5-2dd498236eb6 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 404 len: 111 microversion: 2.1 time: 0.066994 Aug 24 14:39:42.320941 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 139/258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:42 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:39:42.605179 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:42.617569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:42.641951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:42.644864 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:42.647523 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:42.651549 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:42.653281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:42.655393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:42.700087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] HTTP exception thrown: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Request method failure captured: Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f/os-volume_attachments HTTP/1.1 Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfKjZOHtjfQ720FGLH3bKXsM9mn1umjpe4shxgZJWct0fy1LRwAu-19lDVoKRqtUsc4BO9ahZ-BV0i-CgfLQJ4v7g7QFGjsBdqcTflRucMCPDHZY27Y-zK7R3rE-hhqmFqQqwmRDl5GCIAg4ykocYqapZ_QuJi31-ySjcC6XtACCgQ Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 3afce3a011534835893040caf18b19a5 Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:39:42.706361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3afce3a011534835893040caf18b19a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3afce3a011534835893040caf18b19a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3afce3a011534835893040caf18b19a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3afce3a011534835893040caf18b19a5"}]}] Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 3afce3a011534835893040caf18b19a5 Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-DeleteServersTestJSON-1011178164-project Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 7b0a0a0664744f378ca4e17e914f4259 Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-DeleteServersTestJSON-1011178164-project Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.707626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'server_id': 'c668d6f9-dc62-4c9c-800a-52cad818260f'} Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:39:42.708287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:42.709372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:39:42.713469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Returning 404 to user: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:39:42.713469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7d76e108-1822-4861-af61-13f65d07105e tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.114891 Aug 24 14:39:42.714658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 120/259] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:39:42 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f/os-volume_attachments => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:39:42.961652 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:42.975445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:42.987520 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:42.988030 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:42.988478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:42.997524 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:42.998286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:42.998744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:43.277580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:43.284271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4369f041-20d5-4dc9-b89c-f827825e1cc3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.325144 Aug 24 14:39:43.294212 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 140/260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:42 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:44.311583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:44.312264 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:44.326170 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:44.332096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:44.332096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:44.332096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:44.332096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:44.332538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:44.454643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:44.455528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:44.539510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:44.546364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:44.546869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:44.548400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:44.548974 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:44.549407 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:44.575846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] HTTP exception thrown: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Request method failure captured: Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f HTTP/1.1 Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfKjZOHtjfQ720FGLH3bKXsM9mn1umjpe4shxgZJWct0fy1LRwAu-19lDVoKRqtUsc4BO9ahZ-BV0i-CgfLQJ4v7g7QFGjsBdqcTflRucMCPDHZY27Y-zK7R3rE-hhqmFqQqwmRDl5GCIAg4ykocYqapZ_QuJi31-ySjcC6XtACCgQ Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 3afce3a011534835893040caf18b19a5 Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:39:44.577460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3afce3a011534835893040caf18b19a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3afce3a011534835893040caf18b19a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3afce3a011534835893040caf18b19a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3afce3a011534835893040caf18b19a5"}]}] Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 3afce3a011534835893040caf18b19a5 Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-DeleteServersTestJSON-1011178164-project Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 7b0a0a0664744f378ca4e17e914f4259 Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-DeleteServersTestJSON-1011178164-project Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.580858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'c668d6f9-dc62-4c9c-800a-52cad818260f'} Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:39:44.582541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.584946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.591803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Returning 404 to user: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:39:44.591803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8ad3825a-f2ad-4340-b8ff-718dcf171f6f tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 404 len: 111 microversion: 2.1 time: 0.136361 Aug 24 14:39:44.591803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 141/261] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:39:44 2022] DELETE /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:39:44.608422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:44.608800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] [instance: c668d6f9-dc62-4c9c-800a-52cad818260f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:44.618717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:44.622482 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:44.623164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:44.624085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:44.627277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:44.627927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:44.657056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] HTTP exception thrown: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Request method failure captured: Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f HTTP/1.1 Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfKjZOHtjfQ720FGLH3bKXsM9mn1umjpe4shxgZJWct0fy1LRwAu-19lDVoKRqtUsc4BO9ahZ-BV0i-CgfLQJ4v7g7QFGjsBdqcTflRucMCPDHZY27Y-zK7R3rE-hhqmFqQqwmRDl5GCIAg4ykocYqapZ_QuJi31-ySjcC6XtACCgQ Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 3afce3a011534835893040caf18b19a5 Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:39:44.658391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3afce3a011534835893040caf18b19a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3afce3a011534835893040caf18b19a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3afce3a011534835893040caf18b19a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3afce3a011534835893040caf18b19a5"}]}] Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 3afce3a011534835893040caf18b19a5 Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-DeleteServersTestJSON-1011178164 Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-DeleteServersTestJSON-1011178164-project Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 7b0a0a0664744f378ca4e17e914f4259 Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-DeleteServersTestJSON-1011178164-project Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.667350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'c668d6f9-dc62-4c9c-800a-52cad818260f'} Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:39:44.669080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. Aug 24 14:39:44.671542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:39:44.676106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] Returning 404 to user: Instance c668d6f9-dc62-4c9c-800a-52cad818260f could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:39:44.676106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-08e9e724-8340-46b5-a59c-33690c0e9a99 tempest-DeleteServersTestJSON-1011178164 tempest-DeleteServersTestJSON-1011178164-project] 10.222.0.65 "GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f" status: 404 len: 111 microversion: 2.1 time: 0.068265 Aug 24 14:39:44.690162 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 142/262] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:44 2022] GET /compute/v2.1/servers/c668d6f9-dc62-4c9c-800a-52cad818260f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:39:44.754258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:44.762881 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac94a689-596e-4a96-be60-34ccc0916be6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.458791 Aug 24 14:39:44.774900 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 121/263] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:44 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:45.784968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:45.785584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:45.791522 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.792002 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.792435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.793127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:45.793584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:45.794065 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:45.976342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:45.977016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-597a6a04-a13b-477a-b347-64427a393bf5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.195441 Aug 24 14:39:45.977895 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 143/264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:45 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:47.003120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:47.005148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:47.013057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:47.013560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:47.026274 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:47.026996 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:47.027489 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:47.027930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:47.032744 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:47.351120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:47.365910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-addabb46-906e-4b1d-9bd2-a014fa51148a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.368452 Aug 24 14:39:47.378606 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 122/265] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:46 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:48.388741 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:48.389560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:48.402076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:48.402770 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:48.404112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:48.409627 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:48.410170 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:48.410622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:48.704579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:48.711672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2a5f4895-785f-4822-86cb-5e631b74928e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.326965 Aug 24 14:39:48.725445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 144/266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:48 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:49.740406 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:49.742502 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:49.772244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:49.776786 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:49.783063 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:49.785845 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:49.786695 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:49.790528 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:50.059270 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:50.068630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-951de720-00a0-444c-a94f-726fc0c00ff7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.337766 Aug 24 14:39:50.069220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 123/267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:49 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:51.093364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:51.094701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:51.110125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:51.110966 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:51.113136 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:51.116651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:51.117207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:51.117711 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:51.596329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:51.608685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f64ee45d-7b25-4441-b201-2d615d0b9595 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.518097 Aug 24 14:39:51.610275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 145/268] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:51 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:52.636569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:52.637555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:52.681216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:52.682242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:52.683114 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:52.684555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:52.685263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:52.689829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:53.024374 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:53.035556 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5de0c74b-65f7-43fd-a613-81968c5cb37e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.403368 Aug 24 14:39:53.036158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 124/269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:52 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:54.056938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:54.057759 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:54.071133 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:54.072236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:54.075897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:54.076437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:54.077099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:54.077696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:54.346104 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:54.367276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d200c1a7-8611-4315-83ae-6e4a9f869877 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.314580 Aug 24 14:39:54.368032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 146/270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:54 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:55.395730 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:55.396340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:55.398804 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=50 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:55.404091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:55.404838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:55.405433 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:55.406598 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:55.420645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:55.420645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:55.666760 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:55.690670 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f74a0e61-8ac0-4ad8-b2ce-08e27e59352d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.298821 Aug 24 14:39:55.691257 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 125/271] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:55 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:56.713072 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:56.714513 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:56.722131 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:56.722854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:56.724599 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:56.729018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:56.729837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:56.730281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:56.959590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:56.969842 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-63ab5b86-8cba-4359-a770-6cae753b55eb tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.260937 Aug 24 14:39:56.973719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 126/272] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:56 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:57.033238 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d2b529c7-45bf-43ad-a1cc-088a1a9c7b38 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Action: 'create', calling method: .version_select at 0x7fbf785b1820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-624897609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB2rLu1lSLaWbw+bthOejtI01DggM2ViqfnS/bC/wDRZg9QbnK0pgYGyFhrG1E+5WTLWjBbbKQt8nu5EIOdbfCkpscbwW+53vSrwwO0u7lKwMs0VN82WGW3sjR2FEVlHQ=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:39:57.054316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-d2b529c7-45bf-43ad-a1cc-088a1a9c7b38 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Getting quotas for project f22a1cf1a07c47a29772e70e4586a77b. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:39:57.060197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-d2b529c7-45bf-43ad-a1cc-088a1a9c7b38 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Getting quotas for user 3b7c54ebd95f4b3eb396982d75615f23 and project f22a1cf1a07c47a29772e70e4586a77b. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:39:57.127000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d2b529c7-45bf-43ad-a1cc-088a1a9c7b38 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.676540 Aug 24 14:39:57.134651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 147/273] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:39:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:39:58.000505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:58.002706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:58.018404 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:58.019521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:58.020419 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:58.025018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:58.025018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:58.025018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:58.210004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:58.225466 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eb5afbbb-a4bc-4460-bfe8-6d8804ca7ff2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.228409 Aug 24 14:39:58.225466 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 127/274] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:57 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:39:59.243754 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:39:59.245178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:39:59.270466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:59.272843 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:59.273507 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:59.274431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:59.275328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:39:59.275986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:39:59.276708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:39:59.534320 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:39:59.555871 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8830f876-8313-440e-8c41-4a17ad0c4163 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.316033 Aug 24 14:39:59.557427 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 148/275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:39:59 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:00.580529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:00.581151 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:00.588928 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:00.589713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:00.590178 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:00.590904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:00.591365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:00.592166 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:00.830179 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:00.847786 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d585b7ee-54f8-4fca-8143-7731bcae3d8c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.271976 Aug 24 14:40:00.866782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 128/276] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:00 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:01.874790 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:01.877061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:01.884085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:01.884085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:01.884519 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:01.885189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:01.885635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:01.886081 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:02.022321 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:02.030101 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-11a3a628-a6c7-4400-be64-0cc976cf97ba tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.159665 Aug 24 14:40:02.030650 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 149/277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:01 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:03.052584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:03.053196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:03.059750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:03.060233 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:03.060674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:03.061371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:03.061855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:03.062279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:03.203125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:03.212040 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6aae352c-9095-4a1b-943c-dd7357173b27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.163709 Aug 24 14:40:03.212611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 129/278] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:03 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:04.234652 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:04.235293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:04.241540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:04.242166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:04.242606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:04.243296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:04.243739 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:04.244159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:04.380817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:04.388406 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0df2eccd-8260-45cd-9e32-df70c81bfcf4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.158439 Aug 24 14:40:04.388958 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 150/279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:04 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:05.411035 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:05.411664 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:05.418196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:05.418677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:05.419108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:05.419792 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:05.420240 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:05.420658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:05.558915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:05.567455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b4ee3591-0eb6-4483-ba03-59b15719be27 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.161185 Aug 24 14:40:05.568066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 130/280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:05 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:06.588374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:06.588976 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:06.596924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:06.597411 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:06.597897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:06.598605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:06.599066 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:06.599476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:06.739693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:06.748876 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-04bba442-006f-4870-8598-36e6711ffdb0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.164236 Aug 24 14:40:06.752840 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 151/281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:06 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:07.771406 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:07.771967 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:07.778341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:07.778812 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:07.779236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:07.780279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:07.780452 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:07.780876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:07.919300 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:07.927959 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e8321ec0-c1c4-4fdd-9e45-80abaff68b0d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.160779 Aug 24 14:40:07.928644 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 131/282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:07 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:08.949975 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:08.951388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:08.954494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=4 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:08.958874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:08.959512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:08.965810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:08.965810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:08.965810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:08.965810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:09.131675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:09.141061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-45cd80be-eb37-43a7-b685-92313f1c2cde tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1523 microversion: 2.1 time: 0.194928 Aug 24 14:40:09.141898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 152/283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:08 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:10.164496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:10.165099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:10.171655 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:10.172135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:10.172576 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:10.173250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:10.173694 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:10.174136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:10.312208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:10.320317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ddd471ec-40e5-432d-9cef-cfa6ec382839 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1503 microversion: 2.1 time: 0.159959 Aug 24 14:40:10.320893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 132/284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:10 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:10.341739 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:10.342371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:10.349237 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:10.349717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:10.350215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:10.350913 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:10.351363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:10.351784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:10.510029 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:10.517843 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cc701b8c-756e-4ed8-970b-48f6b4de88a2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1515 microversion: 2.1 time: 0.179817 Aug 24 14:40:10.518776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 153/285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:10 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:14.467138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:14.469921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:14.477527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:14.478078 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:14.478531 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.479288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:14.479638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:14.480055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.513226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lazy-loading 'flavor' on Instance uuid 279f90bd-61da-416d-9bd8-de6da5bd41ce {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:40:14.803181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f24b1336-5b47-4e65-87a0-edde59c7596a tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce/action" status: 200 len: 32 microversion: 2.1 time: 0.340040 Aug 24 14:40:14.807561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 133/286] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:40:14 2022] POST /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:40:14.822970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:14.822970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:14.823601 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:14.824095 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:14.824544 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.825246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:14.825708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:14.826639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:14.830671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=75 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:14.963620 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:14.971749 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8c7e6b7f-cabc-4232-b930-7e01060cd9f9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.159830 Aug 24 14:40:14.972327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 154/287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:14 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:15.994445 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:15.995146 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:16.001502 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:16.002021 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:16.002467 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:16.003179 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:16.003831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:16.004388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:16.170797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:16.179068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78d7afe8-031a-48ad-b5f5-db7c64da7487 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.190101 Aug 24 14:40:16.179803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 134/288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:15 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:17.202848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:17.203550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:17.212083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:17.212669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:17.213195 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:17.214004 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:17.214786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:17.215443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:17.373592 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:17.382323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d9cdf371-0124-43e7-8d43-5f0103c23869 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.183913 Aug 24 14:40:17.385794 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 155/289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:17 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:18.404588 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:18.405143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:18.411861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:18.412339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:18.412804 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:18.413542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:18.414013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:18.414432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:18.561021 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:18.569687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1d3786a3-5097-403e-83d8-703a124903e9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.169012 Aug 24 14:40:18.570350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 135/290] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:18 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:19.593083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:19.593701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:19.600799 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:19.601415 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:19.602019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:19.602788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:19.603315 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:19.603803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:19.746747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:19.755208 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-049049e9-f2b9-4f02-9f82-936cce79fcbc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.165749 Aug 24 14:40:19.755788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 156/291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:19 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:20.778116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:20.778846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:20.785213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:20.786319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:20.786747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:20.787420 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:20.787865 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:20.788279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:20.923793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:20.927058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:20.934195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-90d5ac3c-f971-4193-8230-adea58173708 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.159902 Aug 24 14:40:20.934768 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 136/292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:20 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:21.956085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:21.956779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:21.963692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:21.964178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:21.964778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:21.965481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:21.966806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:21.967267 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:22.108102 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:22.117276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-156b71da-9900-4cf9-ba87-ad9356ba5f24 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.164996 Aug 24 14:40:22.130397 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 157/293] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:21 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:23.141392 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:23.142067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:23.150599 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:23.151559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:23.151559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:23.152257 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:23.152711 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:23.153136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:23.292428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:23.300422 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-db9912db-d8b3-4237-9c06-794e280a2fe9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.163888 Aug 24 14:40:23.301815 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 137/294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:23 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:24.323392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:24.323996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:24.329951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:24.330435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:24.330868 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:24.331558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:24.332009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:24.333154 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:24.467522 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:24.475508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-92264cd4-44fb-40e6-a44d-95e20bdf5d6c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.156035 Aug 24 14:40:24.476390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 158/295] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:24 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:25.497633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:25.498269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:25.505562 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:25.506076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:25.506503 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:25.507174 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:25.507617 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:25.508032 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:25.639638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:25.648073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-789ba3e5-2803-4310-8b37-41db8ebf7a11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.154541 Aug 24 14:40:25.648646 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 138/296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:25 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:26.668744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:26.669335 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:26.675687 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:26.676171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:26.677374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:26.678140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:26.678590 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:26.679012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:26.836767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:26.844365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f9b34378-f0d2-4479-b9b7-b1a70175bc17 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.179551 Aug 24 14:40:26.845110 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 159/297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:26 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:27.867314 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:27.867955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:27.870491 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=28 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:27.875452 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:27.876838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:27.877295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:27.878139 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:27.878752 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:27.879236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:28.023348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:28.031491 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bb9a6098-68a6-4ba1-a275-818094c949ab tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.168366 Aug 24 14:40:28.032069 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 139/298] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:27 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:29.055777 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:29.057424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:29.063811 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:29.064294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:29.064722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:29.065418 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:29.065892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:29.066312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:29.200658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:29.208567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1e5d8f30-2f2d-4035-9234-596d4cf7913d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.159383 Aug 24 14:40:29.209742 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 160/299] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:29 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:30.232617 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:30.233251 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:30.239681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:30.240161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:30.241390 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:30.242390 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:30.242855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:30.243393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:30.380365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:30.389394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cca3a917-0eae-41e2-8587-09de632fbe87 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.160814 Aug 24 14:40:30.390096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 140/300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:30 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:31.411938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:31.412837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:31.418801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:31.419334 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:31.419767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:31.420457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:31.420909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:31.421332 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:31.565599 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:31.574210 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-76a59c0f-8e3f-49e2-bc39-f50c2e476f7d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.166169 Aug 24 14:40:31.574766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 161/301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:31 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:32.595559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:32.596173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:32.603172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:32.603658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:32.604094 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:32.604785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:32.605880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:32.605880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:32.745057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:32.752710 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7e2e627d-2770-4f5f-a42c-192062a60d52 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.161183 Aug 24 14:40:32.753282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 141/302] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:32 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:33.777936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:33.777936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:33.783341 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:33.783826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:33.784264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:33.784986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:33.785445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:33.785956 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:34.134830 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:34.143151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-eb4e3999-c8db-454a-b370-81719cf65950 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.370539 Aug 24 14:40:34.143722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 162/303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:33 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:35.166013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:35.166659 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:35.173265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:35.173708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:35.174215 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:35.174912 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:35.175363 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:35.175786 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:35.321869 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:35.329668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d32b61bb-e23a-40a9-98a7-c50d018a18fa tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.168382 Aug 24 14:40:35.330279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 142/304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:35 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:36.353412 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:36.354089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:36.356070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=30 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:36.361149 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:36.361633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:36.362296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:36.362996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:36.363612 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:36.364035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:36.517460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:36.525981 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8b9ec255-eff6-409d-82f8-41f4d448e154 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.177353 Aug 24 14:40:36.526550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 163/305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:36 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:37.549042 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:37.549637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:37.556656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:37.557138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:37.557566 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:37.558286 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:37.558978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:37.559542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:37.695773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:37.703409 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a1e6d9e1-43d5-4759-8982-9883df3ccbda tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.158267 Aug 24 14:40:37.703980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 143/306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:37 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:38.724392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:38.725708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:38.732127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:38.732609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:38.733041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:38.733720 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:38.734200 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:38.734614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:38.876456 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:38.884801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d21157e2-2744-4ac7-b8ae-0cf68b252ef9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.164228 Aug 24 14:40:38.885371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 164/307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:38 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:39.906210 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:39.906813 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:39.913717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:39.914584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:39.915014 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:39.915694 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:39.916139 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:39.916559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:40.356524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:40.356524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-40d163e5-4dac-46eb-a42e-57b50e899600 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.303535 Aug 24 14:40:40.356524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 144/308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:39 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:41.375666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:41.376203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:41.382426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:41.383205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:41.383643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:41.384349 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:41.384807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:41.385281 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:41.525508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:41.533105 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3acecfa8-2956-4a7b-bf1c-5395a14988dc tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.161653 Aug 24 14:40:41.533651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 165/309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:41 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:42.554346 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:42.554938 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:42.561368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.561900 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.562409 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.563363 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:42.564000 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:42.564600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:42.705066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:42.712913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c7be9c1b-06bb-40ac-aad2-cf3f3afacf2d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.162855 Aug 24 14:40:42.713483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 145/310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:42 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:43.744301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:43.744301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:43.744301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:43.744301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:43.745305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:43.745305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:43.745305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:43.745305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:43.875410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:43.883754 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c06e3c39-8cf2-44ab-950a-6493eee6daf2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.153161 Aug 24 14:40:43.884317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 166/311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:43 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:44.904674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:44.905280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:44.911172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:44.911648 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:44.912078 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:44.912759 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:44.913707 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:44.914152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:45.043499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:45.051106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7e66960e-609d-4af7-82ca-5b8fbcc67d62 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.150348 Aug 24 14:40:45.051665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 146/312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:44 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:46.072605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:46.073215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:46.079179 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:46.079660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:46.080093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:46.080781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:46.081232 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:46.081658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:46.084148 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=78 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:46.228705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:46.236821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0777b8ab-f7a6-4670-9ae4-04e1dd5df6e5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.168717 Aug 24 14:40:46.237389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 167/313] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:46 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:47.261357 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:47.263052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:47.269718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.271747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.271747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.271747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.272087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.272510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.408028 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:47.416620 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-480f918f-b71f-478c-98f8-3b1d2cff1b59 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1501 microversion: 2.1 time: 0.161984 Aug 24 14:40:47.417250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 147/314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:47 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:47.437622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bac0f71-9587-4356-80d8-d11bc3b67199"}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:47.443198 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:47.445831 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.446452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.447221 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.447894 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.448344 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.448762 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.472123 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] HTTP exception thrown: Cannot 'attach_volume' instance 279f90bd-61da-416d-9bd8-de6da5bd41ce while it is in vm_state rescued Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Request method failure captured: Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: POST /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce/os-volume_attachments HTTP/1.1 Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 74 Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfTXgYsH_uCUJfw_RHTrVcfWZuvwl5MfL-ONV6ToM9lQxasvAVFAUkas_FvCvirtSAMuI4yIaYvO6wTcH9WvNJRfjugkcJ_JVI0X7snK4GuvM98h5M9_NaBJlX9UxIu4fYv1LxbWGv7hOPUKZuo5xm-IJXTi6uKEbvP_mkItHtXoFc Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:40:47.473933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}] Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 3acc0010e3f54283934b75f58bb6ec93 Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {"volumeAttachment": {"volumeId": "6bac0f71-9587-4356-80d8-d11bc3b67199"}} Aug 24 14:40:47.475535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Cannot 'attach_volume' instance 279f90bd-61da-416d-9bd8-de6da5bd41ce while it is in vm_state rescued Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'server_id': '279f90bd-61da-416d-9bd8-de6da5bd41ce', 'body': {'volumeAttachment': {'volumeId': '6bac0f71-9587-4356-80d8-d11bc3b67199'}}} Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 279f90bd-61da-416d-9bd8-de6da5bd41ce in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:40:47.476638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 279f90bd-61da-416d-9bd8-de6da5bd41ce while it is in vm_state rescued Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:40:47.478712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:40:47.480319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:40:47.480319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:40:47.480319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 279f90bd-61da-416d-9bd8-de6da5bd41ce while it is in vm_state rescued Aug 24 14:40:47.480319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:40:47.480319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Returning 409 to user: Cannot 'attach_volume' instance 279f90bd-61da-416d-9bd8-de6da5bd41ce while it is in vm_state rescued {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:40:47.480319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-eeb3d34d-3c57-4f65-ba7f-1a59a64e4376 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041860 Aug 24 14:40:47.480319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 168/315] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:40:47 2022] POST /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 14:40:47.485629 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:40:47.486197 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:47.492091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.492565 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.493001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.494323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.494769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.495188 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.735554 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-480fdcef-3069-42e8-9703-44f98429682e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce/action" status: 202 len: 0 microversion: 2.1 time: 0.253861 Aug 24 14:40:47.739968 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 148/316] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:40:47 2022] POST /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:40:47.746257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:47.746821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:47.753548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.753925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.754355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.755081 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:47.755528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:47.757378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:47.926867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:47.936134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e5c4d562-8001-4fda-8f25-02437ef3d545 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1509 microversion: 2.1 time: 0.194476 Aug 24 14:40:47.936732 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 169/317] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:47 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:40:48.960831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:48.961516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:48.968775 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.969257 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.969687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:48.970417 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:48.970870 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:48.971284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:49.118878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:49.126613 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d5e4a53d-da57-4fa6-a016-b7b0ffddf1f1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1509 microversion: 2.1 time: 0.169929 Aug 24 14:40:49.127181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 149/318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:48 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:50.147882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:50.148524 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:50.155335 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.155846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.156285 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.156980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:50.157457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:50.157923 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:50.288363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:50.296095 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-387fb5e1-16af-4a8b-a69b-4aea5b8d0ed1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1509 microversion: 2.1 time: 0.152149 Aug 24 14:40:50.296661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 170/319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:50 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:51.317378 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:51.318066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:51.325048 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.325546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.325988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.329158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:51.329158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:51.329158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:51.463085 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:51.470870 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8bea9659-b29a-4008-9eef-e9f67373cb0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1509 microversion: 2.1 time: 0.157433 Aug 24 14:40:51.471418 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 150/320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:51 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:52.491611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:52.492141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:52.498223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:52.498706 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:52.500068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:52.500068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:52.500270 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:52.500659 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:52.631066 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:52.639222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-da0f4f55-f1ac-47cf-93a6-0c44955cb5b3 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1509 microversion: 2.1 time: 0.151636 Aug 24 14:40:52.639787 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 171/321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:52 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:40:53.660483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:40:53.661080 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:40:53.667978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:53.668452 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:53.668876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:53.669552 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:40:53.670019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:40:53.670436 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:40:53.797995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:40:53.805442 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-46748517-f5ef-410d-a451-dfb306e80f89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1515 microversion: 2.1 time: 0.148786 Aug 24 14:40:53.806029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 151/322] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:40:53 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:10.223800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-791e07ba-4f86-4266-bdda-db0c0603191f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'create', calling method: .version_select at 0x7fbf783e3dc0>, body: {"keypair": {"name": "tempest-keypair-1243712867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0Cv9MoAQ+15UqMWJex22F89maRno0nx6hqmXkNVgj8avU3GfcRGTP946ANAlNM+6uLFlyPhTQicR3o6MLkiVZhZJ732JK16/eoV/S1zBs013wsmquG8mnFBpmO6ltdBw=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:10.229737 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=17 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:10.230416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=27 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:10.243748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-791e07ba-4f86-4266-bdda-db0c0603191f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Getting quotas for project 6c5abfb715e14ddf84e0b4519a3d724b. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:41:10.247954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-791e07ba-4f86-4266-bdda-db0c0603191f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Getting quotas for user 3acc0010e3f54283934b75f58bb6ec93 and project 6c5abfb715e14ddf84e0b4519a3d724b. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:41:10.370161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-791e07ba-4f86-4266-bdda-db0c0603191f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150308 Aug 24 14:41:10.370693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 172/323] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:41:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:12.327733 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2005803611", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-624897609", "security_groups": [{"name": "tempest-secgroup-smoke-1621191805"}], "block_device_mapping_v2": [{"uuid": "6db01299-05bd-473f-8a9c-9228d16074f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2213b9d9-5655-4f75-b8cc-83ad6d8a04df"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:12.338240 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=25 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:12.339166 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:12.493792 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] validate_networks() for [('2213b9d9-5655-4f75-b8cc-83ad6d8a04df', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:41:13.077157 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:41:13.077653 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:41:13.078160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:41:13.080873 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:41:13.080873 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:41:13.089428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.090017 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.090507 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.091340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.092085 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.092989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.112785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Getting quotas for project f22a1cf1a07c47a29772e70e4586a77b. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:41:13.117911 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Getting quotas for user 3b7c54ebd95f4b3eb396982d75615f23 and project f22a1cf1a07c47a29772e70e4586a77b. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:41:13.153820 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1014627846", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0959b601-d8f6-44ff-a066-1c3353918db7"}], "security_groups": [{"name": "tempest-securitygroup--1789455251"}], "key_name": "tempest-keypair-1243712867", "user_data": "}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:13.182995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:41:13.185986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6db01299-05bd-473f-8a9c-9228d16074f8',volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:41:13.277020 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] validate_networks() for [('0959b601-d8f6-44ff-a066-1c3353918db7', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:41:13.621715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [f3202f46-6099-470b-9c6c-de3a542a77cb] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 14:41:13.722616 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:41:13.723037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:41:13.723516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:41:13.723919 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:41:13.724336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:41:13.735588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.736087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.736529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.738166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:13.739342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:13.739814 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:13.759188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Getting quotas for project 6c5abfb715e14ddf84e0b4519a3d724b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:41:13.764550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Getting quotas for user 3acc0010e3f54283934b75f58bb6ec93 and project 6c5abfb715e14ddf84e0b4519a3d724b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:41:13.776767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:41:13.779507 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:41:13.914764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4d6c9cb8-aa3a-4784-b0cd-0c45c2fd97c8 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.765297 Aug 24 14:41:13.915276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 173/324] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:41:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 14:41:13.926807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e86d4954-49dd-49c9-a9a3-02bec3824a99 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:13.927420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e86d4954-49dd-49c9-a9a3-02bec3824a99 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:13.986704 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e86d4954-49dd-49c9-a9a3-02bec3824a99 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:13.998233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e86d4954-49dd-49c9-a9a3-02bec3824a99 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1246 microversion: 2.1 time: 0.074534 Aug 24 14:41:14.014381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 174/325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:13 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:14.629588 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [f3202f46-6099-470b-9c6c-de3a542a77cb] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 45574. Aug 24 14:41:14.633393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fe24d516-4f89-4da0-a4be-4cfb12042074 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.310193 Aug 24 14:41:14.634288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 152/326] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:41:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:41:14.646287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ef908daf-c79e-4045-ad7e-a6b5b81da5dc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:14.646902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ef908daf-c79e-4045-ad7e-a6b5b81da5dc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:14.705113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ef908daf-c79e-4045-ad7e-a6b5b81da5dc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:14.712079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ef908daf-c79e-4045-ad7e-a6b5b81da5dc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1094 microversion: 2.1 time: 0.069634 Aug 24 14:41:14.714019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 175/327] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:14 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:15.019781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:15.020399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:15.026753 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:15.027238 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:15.027708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:15.028403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:15.028926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:15.029351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:15.093368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:15.101215 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fe590c4e-b8a3-40dd-bb39-8c1f2631e08e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1250 microversion: 2.1 time: 0.085238 Aug 24 14:41:15.101821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 153/328] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:15 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:15.734000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-edce978c-f10d-4874-a21c-bb9dad7f491d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:15.734614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-edce978c-f10d-4874-a21c-bb9dad7f491d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:15.802614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-edce978c-f10d-4874-a21c-bb9dad7f491d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:15.811187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-edce978c-f10d-4874-a21c-bb9dad7f491d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1094 microversion: 2.1 time: 0.081472 Aug 24 14:41:15.812022 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 176/329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:15 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:16.123394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:16.124105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:16.131649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:16.132422 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:16.133032 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.133823 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:16.139015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:16.139015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:16.449103 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:16.461490 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-392944e9-6065-42ba-b9f3-7072f0251a92 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1306 microversion: 2.1 time: 0.341976 Aug 24 14:41:16.461628 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 154/330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:16 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1306 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:16.833140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3103dc3a-9aea-4081-b348-17f17dc98d88 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:16.839499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3103dc3a-9aea-4081-b348-17f17dc98d88 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:16.920752 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3103dc3a-9aea-4081-b348-17f17dc98d88 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:16.933948 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3103dc3a-9aea-4081-b348-17f17dc98d88 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1094 microversion: 2.1 time: 0.104520 Aug 24 14:41:16.934690 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 177/331] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:16 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1094 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:17.484779 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:17.485594 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:17.492932 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.494271 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.494993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.496183 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:17.496913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:17.497660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:17.726871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:17.737782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5fa9cb53-cb20-4889-be27-380e25319d05 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.257967 Aug 24 14:41:17.739003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 155/332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:17 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:17.960579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4f23527a-08f1-4175-8167-88f7aa1ef347 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:17.962094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4f23527a-08f1-4175-8167-88f7aa1ef347 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:18.026190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4f23527a-08f1-4175-8167-88f7aa1ef347 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:18.035835 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4f23527a-08f1-4175-8167-88f7aa1ef347 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1094 microversion: 2.1 time: 0.079100 Aug 24 14:41:18.036418 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 178/333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:17 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:18.537408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-fb495c32-fea5-49c6-8249-942ee75ad627 req-5502cb46-7cb4-4fce-8c5c-b2fb0b6fe189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d040cfc-ac45-4941-b04f-a8ba0f061929", "tag": "8789513b-ca10-4941-a025-8a463c9cf8d1"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:18.551667 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-fb495c32-fea5-49c6-8249-942ee75ad627 req-5502cb46-7cb4-4fce-8c5c-b2fb0b6fe189 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.553600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-fb495c32-fea5-49c6-8249-942ee75ad627 req-5502cb46-7cb4-4fce-8c5c-b2fb0b6fe189 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.553600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-fb495c32-fea5-49c6-8249-942ee75ad627 req-5502cb46-7cb4-4fce-8c5c-b2fb0b6fe189 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.565310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-fb495c32-fea5-49c6-8249-942ee75ad627 req-5502cb46-7cb4-4fce-8c5c-b2fb0b6fe189 service nova] Creating event network-changed:8789513b-ca10-4941-a025-8a463c9cf8d1 for instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 on hv-cinder-75671 Aug 24 14:41:18.571053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-fb495c32-fea5-49c6-8249-942ee75ad627 req-5502cb46-7cb4-4fce-8c5c-b2fb0b6fe189 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038809 Aug 24 14:41:18.571632 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 156/334] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:18.764784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:18.765396 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:18.771689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.772182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.772644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.773439 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:18.774108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:18.774676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:18.929459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:18.937203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e06a1c77-3861-4bad-a422-aea64cb2ebed tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.176985 Aug 24 14:41:18.937787 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 179/335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:18 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:19.063445 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:19.064142 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:19.070386 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.070996 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.071445 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.072109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.072586 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.073004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.161217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:19.170431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-efbb1da4-9076-4c8b-99c9-234b503269ae tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1144 microversion: 2.1 time: 0.110881 Aug 24 14:41:19.171010 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 157/336] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:19 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1144 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:19.957928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:19.958453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:19.964287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.964768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.965201 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:19.965921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:19.966522 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:19.966950 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:20.097327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:20.105070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-45b04b09-1ddb-4ddd-8ca6-ac3a2be1e132 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.151028 Aug 24 14:41:20.105635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 180/337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:19 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:20.191956 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:20.192582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:20.199092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:20.202563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:20.202563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:20.202563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:20.202563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:20.202945 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:20.264737 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:20.272909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4463146d-fc14-49ec-bb54-61c57a5e237f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1144 microversion: 2.1 time: 0.084809 Aug 24 14:41:20.273477 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 158/338] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:20 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:21.126413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:21.126992 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:21.132780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.133275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.133684 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.134387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.134834 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.135253 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.267516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:21.275214 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7aac3c8d-bcc3-4ce0-a904-f59894dfe941 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.152949 Aug 24 14:41:21.275775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 181/339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:21 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:21.293463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:21.294111 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:21.301137 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.301621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.302093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.302783 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:21.303236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:21.303656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:21.364498 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:21.372241 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-84fe56ae-9d3d-441f-8374-1087293ead9c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1144 microversion: 2.1 time: 0.082587 Aug 24 14:41:21.373066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 159/340] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:21 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:22.296783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:22.297419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:22.303286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.303764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.304196 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.304876 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.305328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.305767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.393243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:22.393891 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:22.400511 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.400997 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.401439 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.402172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:22.402626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:22.403052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:22.441035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:22.449002 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5ba48e54-ca7a-4e7e-975e-5fa99e7bd73f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.156241 Aug 24 14:41:22.449580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 182/341] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:22 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:22.468157 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:22.475841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7164cb6c-3e82-4635-80df-562f6557d749 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1144 microversion: 2.1 time: 0.086470 Aug 24 14:41:22.476403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 160/342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:22 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:23.470488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:23.471098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:23.477006 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.477487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.477953 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.478641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.479123 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.479542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.496996 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:23.498288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:23.500246 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:23.500900 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:23.506158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.506652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.507075 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.507766 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:23.508216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:23.508640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:23.582837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:23.590851 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-de5221aa-23c5-4afa-9a94-13e1872ae11f tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1144 microversion: 2.1 time: 0.097674 Aug 24 14:41:23.592015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 161/343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:23 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:23.646060 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:23.653934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-962345e5-c4da-41b4-840e-f61d304c6ac5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.187188 Aug 24 14:41:23.654676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 183/344] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:23 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:24.613084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:24.616350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:24.620943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.621470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.621956 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.623369 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.623827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.624335 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.677041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:24.678294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:24.680700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:24.686226 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.690937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.690937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.690937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:24.690937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:24.691265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:24.695840 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:24.703680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4ead44f2-238f-484a-82c4-03a246c26711 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1136 microversion: 2.1 time: 0.094331 Aug 24 14:41:24.704259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 162/345] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:24 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1136 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:24.824855 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:24.832848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c4df9599-0449-4e8a-990c-0cf579b8e24b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.161054 Aug 24 14:41:24.833423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 184/346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:24 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:25.724619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:25.725230 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:25.732963 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.733488 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.733975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.734682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.735121 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.735538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.807092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:25.816034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f95aad1-dcf6-49f0-b77d-f7755feca5c0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1136 microversion: 2.1 time: 0.095126 Aug 24 14:41:25.818164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 163/347] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:25 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1136 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:25.853338 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:25.853985 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:25.860919 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.861379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.861831 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.862544 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:25.862988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:25.863482 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:25.907051 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-297936831", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "networks": [{"uuid": "98041d2c-8006-493f-9a5d-db66e17a9b0b"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:25.967874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] validate_networks() for [('98041d2c-8006-493f-9a5d-db66e17a9b0b', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:41:26.222746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:26.243484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-30d2af21-9d3c-4815-9810-105d5e46b106 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.393662 Aug 24 14:41:26.244647 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 185/348] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:25 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:26.463422 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:41:26.463841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:41:26.464309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:41:26.464713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:41:26.465129 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:41:26.474525 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.474997 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.475431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.476211 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.476661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.477109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.495906 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Getting quotas for project f69f30ea5d3642c28a38c6f75c8bb57b. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:41:26.500835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Getting quotas for user a902794de84d477e890e0e6a861c102d and project f69f30ea5d3642c28a38c6f75c8bb57b. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:41:26.512146 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:41:26.515220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:41:26.645285 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eedce631-2267-4d0d-8228-98309375f532 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743850 Aug 24 14:41:26.645957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 164/349] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:41:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 14:41:26.656730 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-21e33c3e-c7b1-4c91-83fb-bc3a28b6a7e0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:26.657339 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-21e33c3e-c7b1-4c91-83fb-bc3a28b6a7e0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:26.711114 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-21e33c3e-c7b1-4c91-83fb-bc3a28b6a7e0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:26.718046 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-21e33c3e-c7b1-4c91-83fb-bc3a28b6a7e0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1213 microversion: 2.1 time: 0.065053 Aug 24 14:41:26.721968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 186/350] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:26 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:26.838875 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:26.839486 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:26.845930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.847014 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.847014 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.847544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:26.848003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:26.848426 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:26.914216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:26.922885 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e2b59ac2-d928-4aa8-8272-3fc35610bffd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1136 microversion: 2.1 time: 0.088284 Aug 24 14:41:26.923448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 165/351] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:26 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1136 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:27.275976 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:27.276558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:27.286695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.286695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.286695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:27.286695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.286991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.286991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:27.424156 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:27.432954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-84d2ff3c-4e48-42fe-abfd-ea8abc49e1b4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.160813 Aug 24 14:41:27.434025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 187/352] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:27 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:27.739717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:27.740356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:27.746483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.746971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.747974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:27.748844 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.749298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.749721 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:27.814060 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:27.824266 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c5b1a4f9-e119-4562-9275-c248e86e733b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1217 microversion: 2.1 time: 0.088472 Aug 24 14:41:27.824854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 166/353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:27 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:27.943605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:27.944218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:27.950828 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.951563 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.952000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:27.952704 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:27.953161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:27.953580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.018137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:28.026591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5ade8340-72e8-42f3-8c0d-ba652f835262 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1136 microversion: 2.1 time: 0.086796 Aug 24 14:41:28.027171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 188/354] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:27 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:28.455830 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:28.456478 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:28.463361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.463833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.464271 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.464975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.465430 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.466549 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.616020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:28.623818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-48ed05b0-95ec-4bd1-9fb2-e5567d4bd1dd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.171827 Aug 24 14:41:28.624931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 167/355] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:28 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:28.847341 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:28.847956 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:28.854765 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.855499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.855934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.857001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:28.857666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:28.858125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:28.954737 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:28.973473 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2951fca2-d899-48f8-af3d-2e05f315b436 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1217 microversion: 2.1 time: 0.127294 Aug 24 14:41:28.973473 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 189/356] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:28 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:29.053219 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:29.054284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:29.064821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.065642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.066249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.066972 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.067435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.067863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.143960 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:29.151925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-569745e4-e687-4583-b84b-50f69f803e49 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1136 microversion: 2.1 time: 0.106034 Aug 24 14:41:29.152510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 168/357] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:29 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1136 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:29.646467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:29.646993 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:29.653080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.654112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.654665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.655580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:29.656040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:29.656469 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:29.804307 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:29.816973 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cb5ec917-e5ea-4989-b9e1-9490a9279b89 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.174308 Aug 24 14:41:29.817584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 190/358] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:29 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:29.993120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:29.994054 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:30.002560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.003313 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.003881 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.005018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.005452 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.006231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.092609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:30.104057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-27efe636-1e3a-409e-bb54-d1e77e81557d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1209 microversion: 2.1 time: 0.114827 Aug 24 14:41:30.105459 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 169/359] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:29 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:30.173417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:30.174764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:30.186699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.187272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.190173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.190576 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.192754 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.194018 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.322475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:30.332108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-78faf11f-00dd-4515-b294-19c9c1783213 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1192 microversion: 2.1 time: 0.163030 Aug 24 14:41:30.332798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 191/360] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:30 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1192 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:30.839536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:30.840684 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:30.847845 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.848374 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.848819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.849533 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:30.850084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:30.850515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:30.872561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:31.131829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:31.133471 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:31.151778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.151778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.151778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.151778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.152597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.154094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.493348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:31.503239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-57bef543-617c-4059-9e39-82aa7909afac tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1273 microversion: 2.1 time: 0.378392 Aug 24 14:41:31.503822 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 192/361] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:31 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:31.508844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:31.509648 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:31.529570 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.530547 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.531339 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.532372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:31.533026 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:31.533812 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:31.577658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:31.588363 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0843af69-30ef-4109-95fd-86b12d84b9f6 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.752959 Aug 24 14:41:31.588948 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 170/362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:30 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:31.626354 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:31.642037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c4f9f2e0-0dbd-456e-8ec3-82573219ed1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1210 microversion: 2.1 time: 0.136900 Aug 24 14:41:31.642854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 193/363] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:31 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:32.529711 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:32.530468 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:32.538927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.539581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.540329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.541359 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.542120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.542838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.606996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-bd7e85dd-3ab0-40fa-be1a-e59a4c83968e req-07085add-81f7-48ba-a7df-94535f6b5faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d040cfc-ac45-4941-b04f-a8ba0f061929", "name": "network-vif-plugged", "status": "completed", "tag": "8789513b-ca10-4941-a025-8a463c9cf8d1"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:32.624405 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-bd7e85dd-3ab0-40fa-be1a-e59a4c83968e req-07085add-81f7-48ba-a7df-94535f6b5faa service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.625287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-bd7e85dd-3ab0-40fa-be1a-e59a4c83968e req-07085add-81f7-48ba-a7df-94535f6b5faa service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.626200 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-bd7e85dd-3ab0-40fa-be1a-e59a4c83968e req-07085add-81f7-48ba-a7df-94535f6b5faa service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.649562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-bd7e85dd-3ab0-40fa-be1a-e59a4c83968e req-07085add-81f7-48ba-a7df-94535f6b5faa service nova] Creating event network-vif-plugged:8789513b-ca10-4941-a025-8a463c9cf8d1 for instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 on hv-cinder-75671 Aug 24 14:41:32.659073 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-bd7e85dd-3ab0-40fa-be1a-e59a4c83968e req-07085add-81f7-48ba-a7df-94535f6b5faa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057002 Aug 24 14:41:32.660190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 194/364] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:32.675252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:32.677288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:32.688058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.688774 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.689360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.690460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.691150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.691825 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.734777 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:32.749892 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-11b0d7bc-c617-483b-b80d-1ed3da5b4a73 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1271 microversion: 2.1 time: 0.223863 Aug 24 14:41:32.766922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 171/365] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:32 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:32.772223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:32.779896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:32.787970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.788801 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.789597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:32.791171 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:32.792522 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:32.795017 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.318708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:33.320415 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:33.335144 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-905b5ef5-00c9-4e6c-a4e1-431c81d6b7df tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.668508 Aug 24 14:41:33.338712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 195/366] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:32 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:33.344170 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e92d9796-7aa9-44db-bce0-f4740eeccf44 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1278 microversion: 2.1 time: 0.575397 Aug 24 14:41:33.345541 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 172/367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:32 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1278 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:33.774541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:33.775317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:33.785401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:33.786263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:33.786881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:33.787745 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:33.788411 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:33.789055 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:34.159084 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:34.164268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:34.171866 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-20e295d8-205d-4045-9188-52c2d9d439ed tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.401258 Aug 24 14:41:34.172667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 196/368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:33 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:34.369062 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:34.370322 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:34.379987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:34.380906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:34.381530 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:34.382429 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:34.383073 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:34.383655 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:34.385341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:34.406180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:34.433383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:34.434327 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:34.437402 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:34.439024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:34.440825 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:34.446368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.174336 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:35.178445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:35.183809 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bf6bf480-7079-47da-b1a0-10ae8edefbb2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1372 microversion: 2.1 time: 0.820726 Aug 24 14:41:35.193334 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-59b6f20b-2dc1-48ca-811b-d961daa3e3b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.829420 Aug 24 14:41:35.194172 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 197/369] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:34 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:35.194469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 173/370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:34 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1372 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:35.205310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:35.205960 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:35.211655 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-e424eb89-a3f4-4046-b811-34744025ce41 req-0c9b8dfa-50b4-4119-985c-6c02e6206a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7975e08b-1d91-48ec-a6c1-8f783b911af5", "tag": "91cf19ee-5586-4ad3-b92c-c90e8cfafa8d"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:35.218427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.218930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.219364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.220522 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.220798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.221394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.222945 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e424eb89-a3f4-4046-b811-34744025ce41 req-0c9b8dfa-50b4-4119-985c-6c02e6206a45 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:35.223437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e424eb89-a3f4-4046-b811-34744025ce41 req-0c9b8dfa-50b4-4119-985c-6c02e6206a45 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:35.223848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e424eb89-a3f4-4046-b811-34744025ce41 req-0c9b8dfa-50b4-4119-985c-6c02e6206a45 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:35.236889 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-e424eb89-a3f4-4046-b811-34744025ce41 req-0c9b8dfa-50b4-4119-985c-6c02e6206a45 service nova] Creating event network-changed:91cf19ee-5586-4ad3-b92c-c90e8cfafa8d for instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 on hv-cinder-75671 Aug 24 14:41:35.242675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-e424eb89-a3f4-4046-b811-34744025ce41 req-0c9b8dfa-50b4-4119-985c-6c02e6206a45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046886 Aug 24 14:41:35.243363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 198/371] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:35.377688 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:35.385950 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b50d0ccc-87fa-4e77-9f75-4ab648c8f39a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.190247 Aug 24 14:41:35.396712 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 174/372] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:35 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:36.208902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:36.209992 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:36.217970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.218443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.219038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.222677 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.222677 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.222677 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.223720 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:36.224358 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:36.233164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.233709 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.234281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.235099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.235758 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.236193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.450615 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.459368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-560a5d97-4369-4000-89e4-03fd1a0fe39f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1566 microversion: 2.1 time: 0.255358 Aug 24 14:41:36.460341 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 199/373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:36 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1566 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:36.466192 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:36.466850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:36.473041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.475241 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.476219 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.476870 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.480368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.480368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.480694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.496298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a79bacef-3893-428a-b53d-b6ef7ca0378b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.269462 Aug 24 14:41:36.496298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 175/374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:36 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:36.496298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:36.496631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:36.502480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:36.505115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.506006 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.507125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.508925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:36.510222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:36.511283 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:36.513494 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:36.648350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-43becb35-1922-4433-aa11-a7964e1da7f7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157742 Aug 24 14:41:36.649546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 176/375] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 14:41:36 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:36.715236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=22 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:36.780832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:36.788766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f3d04b1f-d9df-49f8-91b2-583df5f5b5f0 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.327215 Aug 24 14:41:36.789352 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 200/376] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:36 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:37.267571 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-e0bd5316-83e5-425c-b527-473dc93a9bcb req-23e6c9b5-7d38-4b5f-8e7d-5b5fe2231ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63abd5d6-f857-4ef2-b91f-4c77e4470c03", "tag": "ae57d99b-5421-474a-8ef3-618bf4d1ed88"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:37.279919 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e0bd5316-83e5-425c-b527-473dc93a9bcb req-23e6c9b5-7d38-4b5f-8e7d-5b5fe2231ede service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.280668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e0bd5316-83e5-425c-b527-473dc93a9bcb req-23e6c9b5-7d38-4b5f-8e7d-5b5fe2231ede service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.281304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e0bd5316-83e5-425c-b527-473dc93a9bcb req-23e6c9b5-7d38-4b5f-8e7d-5b5fe2231ede service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.292974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-e0bd5316-83e5-425c-b527-473dc93a9bcb req-23e6c9b5-7d38-4b5f-8e7d-5b5fe2231ede service nova] Creating event network-changed:ae57d99b-5421-474a-8ef3-618bf4d1ed88 for instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 on hv-cinder-75671 Aug 24 14:41:37.297986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-e0bd5316-83e5-425c-b527-473dc93a9bcb req-23e6c9b5-7d38-4b5f-8e7d-5b5fe2231ede service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037113 Aug 24 14:41:37.298605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 177/377] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:37.526003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:37.526609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:37.534247 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.539746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.539746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.539746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.539746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.540103 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.811646 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:37.812397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:37.819136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.819630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.820057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:37.820759 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:37.821204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:37.821624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:38.268801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:38.277087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2925f7ca-64e5-41f0-ae4c-76a495b38da3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.755584 Aug 24 14:41:38.277663 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 201/378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:37 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:38.293659 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1227653357", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452"}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:38.303238 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:38.356171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] validate_networks() for None {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:41:38.545893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:38.554661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-073155ca-5863-43cf-9ba9-3de409584142 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.747983 Aug 24 14:41:38.555289 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 178/379] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:37 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:39.158766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:41:39.158766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:41:39.158766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:41:39.158766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:41:39.159740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:41:39.169184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.169983 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.170646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.171382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.171834 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.172256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.191728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Getting quotas for project 96b55635cff7462ba4702b7b1600406d. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:41:39.196056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Getting quotas for user b9beccc8676245ec8082032efcb19ef6 and project 96b55635cff7462ba4702b7b1600406d. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:41:39.215024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:41:39.217090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:41:39.299518 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:39.300133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:39.307805 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.308300 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.308955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.310144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.310645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.311069 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.438710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c9bc1e95-dbef-4d03-8cce-27454d63d9a9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159922 Aug 24 14:41:39.445888 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 202/380] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:41:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:41:39.452900 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-302969a7-940e-4a45-aa8d-c7c8bf92efc4 req-e291c03d-eedf-42b7-9e7a-e45c271e3421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d040cfc-ac45-4941-b04f-a8ba0f061929", "tag": "8789513b-ca10-4941-a025-8a463c9cf8d1"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:39.477991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-302969a7-940e-4a45-aa8d-c7c8bf92efc4 req-e291c03d-eedf-42b7-9e7a-e45c271e3421 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.478470 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-302969a7-940e-4a45-aa8d-c7c8bf92efc4 req-e291c03d-eedf-42b7-9e7a-e45c271e3421 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.478896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-302969a7-940e-4a45-aa8d-c7c8bf92efc4 req-e291c03d-eedf-42b7-9e7a-e45c271e3421 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.493721 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-302969a7-940e-4a45-aa8d-c7c8bf92efc4 req-e291c03d-eedf-42b7-9e7a-e45c271e3421 service nova] Creating event network-changed:8789513b-ca10-4941-a025-8a463c9cf8d1 for instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 on hv-cinder-75671 Aug 24 14:41:39.501096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-302969a7-940e-4a45-aa8d-c7c8bf92efc4 req-e291c03d-eedf-42b7-9e7a-e45c271e3421 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053402 Aug 24 14:41:39.502040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 203/381] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:39.507760 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5dab3bc8-fcbb-4bc1-b1e8-36472c84c008 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:39.509277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5dab3bc8-fcbb-4bc1-b1e8-36472c84c008 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:39.519017 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:39.530024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-77b3ff6c-7df5-44e8-8e0c-d625f34428db tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.234262 Aug 24 14:41:39.531244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 179/382] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:39 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:39.583689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5dab3bc8-fcbb-4bc1-b1e8-36472c84c008 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:39.590223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:39.590223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:39.595316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5dab3bc8-fcbb-4bc1-b1e8-36472c84c008 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1215 microversion: 2.1 time: 0.092063 Aug 24 14:41:39.595909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 204/383] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:39 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:39.599614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.600116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.600554 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.601292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:39.601719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:39.602172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:39.757052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:39.766975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4cf82bc3-bfae-4ad4-a0e7-98dc01f23f99 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.189548 Aug 24 14:41:39.767559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 180/384] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:39 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:40.553854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:40.554642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:40.562442 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.562927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.563357 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.564058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.564537 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.564957 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.629436 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d32d4c80-5d6c-4c92-933f-053a403142fb tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:40.631431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d32d4c80-5d6c-4c92-933f-053a403142fb tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:40.742882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d32d4c80-5d6c-4c92-933f-053a403142fb tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:40.753721 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d32d4c80-5d6c-4c92-933f-053a403142fb tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1215 microversion: 2.1 time: 0.138703 Aug 24 14:41:40.755339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 181/385] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:40 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:40.759985 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:40.768255 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-90d9af7a-e3d6-44a3-9a35-9f4a2c316dd7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.218776 Aug 24 14:41:40.768959 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 205/386] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:40 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:40.790241 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:40.790906 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:40.797083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.797562 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.798032 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.798712 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:40.799184 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:40.799600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:40.942124 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:40.950825 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f601ec75-044d-4ad0-a4de-63aa1a3c4939 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.163775 Aug 24 14:41:40.951379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 182/387] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:40 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:41.776671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.777211 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.783579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.784053 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.784573 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.785347 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.785893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.786317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.789502 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.790190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.797564 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.798072 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.798542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.799233 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.799692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.801902 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.853342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:41.863013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5e7bc07c-ab34-4ac7-9dec-94f32a173ca9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1219 microversion: 2.1 time: 0.090476 Aug 24 14:41:41.865188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 206/388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:41 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:41.960707 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:41.969721 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-598aaf03-055b-4956-990b-bfb467de9095 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.183983 Aug 24 14:41:41.970383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 183/389] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:41 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:41.975605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:41.976260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:41.985138 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.985712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.986214 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:41.986925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:41.987386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:41.987820 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.165478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.178420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d57d6158-bade-4e8a-bcdc-61c6bf634a31 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.206314 Aug 24 14:41:42.179692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 207/390] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:41 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:42.891288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:42.891860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:42.894383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:42.899242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.899746 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.900235 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.900942 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:42.901421 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:42.901896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:42.972930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:42.983247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1c9ce242-a530-4d14-8de6-b0c2bfbef5f1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1211 microversion: 2.1 time: 0.096467 Aug 24 14:41:42.983846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 184/391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:42 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:42.997671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:42.998847 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:43.008195 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.008714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.009184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.010002 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.010459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.010888 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.203402 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:43.204021 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:43.210320 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.210819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.211256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.211976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:43.212431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:43.213073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:43.467166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:43.477880 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0ae0cd96-66dd-4cbb-9c5b-774b8a82eacc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.485274 Aug 24 14:41:43.478660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 208/392] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:42 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:43.482826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:43.498906 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-70378f6c-6658-40f3-a51d-d5e89ca85aa8 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.299160 Aug 24 14:41:43.500091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 185/393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:43 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:44.005488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:44.006260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:44.012199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.013470 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.014128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.014825 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.015279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.015699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.081548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.089961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b7377e49-cd30-4b75-9fbd-8f0e87990309 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1211 microversion: 2.1 time: 0.088289 Aug 24 14:41:44.090578 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 209/394] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:44 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:44.510742 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:44.512123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:44.521150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.522052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.522693 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.523859 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.524544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.525157 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.526903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:44.533381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:44.559491 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.560786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.563501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.566073 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.567222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.572511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.766490 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.775116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-607137be-407b-427b-9915-77278a70fbb9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.268670 Aug 24 14:41:44.775948 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 186/395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:44 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:44.795252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:44.799831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-65f97d4b-edff-4955-a7c0-d72db69d253c req-9880d668-973e-4e67-a876-068b0d8bcb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63abd5d6-f857-4ef2-b91f-4c77e4470c03", "name": "network-vif-plugged", "status": "completed", "tag": "ae57d99b-5421-474a-8ef3-618bf4d1ed88"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:44.803330 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-bf86fc87-526d-4cf8-a5b0-301476b97864 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.285842 Aug 24 14:41:44.803903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 210/396] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:44 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:44.811536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-65f97d4b-edff-4955-a7c0-d72db69d253c req-9880d668-973e-4e67-a876-068b0d8bcb8e service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:44.814264 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-65f97d4b-edff-4955-a7c0-d72db69d253c req-9880d668-973e-4e67-a876-068b0d8bcb8e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:44.814264 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-65f97d4b-edff-4955-a7c0-d72db69d253c req-9880d668-973e-4e67-a876-068b0d8bcb8e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:44.826558 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-65f97d4b-edff-4955-a7c0-d72db69d253c req-9880d668-973e-4e67-a876-068b0d8bcb8e service nova] Creating event network-vif-plugged:ae57d99b-5421-474a-8ef3-618bf4d1ed88 for instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 on hv-cinder-75671 Aug 24 14:41:44.831582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-65f97d4b-edff-4955-a7c0-d72db69d253c req-9880d668-973e-4e67-a876-068b0d8bcb8e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035926 Aug 24 14:41:44.832163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 187/397] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:45.112635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:45.118751 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:45.119490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.119986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.120420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.121128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.121581 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.122038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.188287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:45.196728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7ae1c42a-42f1-4fc3-8f3d-f684f8b5a43c tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1267 microversion: 2.1 time: 0.087896 Aug 24 14:41:45.197447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 211/398] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:45 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:45.798664 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:45.799384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:45.806081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.806645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.807022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.807708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.808159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.808579 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.824863 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:45.825494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:45.834065 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.835182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.835620 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:45.836409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:45.838167 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:45.838612 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:46.028572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:46.036624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:46.039556 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6737ecb9-db98-442c-ae7e-618e2f0c19a6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.246370 Aug 24 14:41:46.040272 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 188/399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:45 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:46.053069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-19602c15-2bf8-494e-aadf-d7a1396b469b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.231200 Aug 24 14:41:46.054641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 212/400] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:45 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:46.219802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:46.221913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:46.227418 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:46.227904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:46.228337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:46.229055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:46.229835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:46.229991 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:46.303843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:46.307843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:46.312482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a282be73-d996-4f5d-81da-95c7afb7c556 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1273 microversion: 2.1 time: 0.097689 Aug 24 14:41:46.315640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 189/401] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:46 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:47.063189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:47.063666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:47.070122 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.071828 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.071828 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.073854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.073854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.073854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.079540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:47.080868 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:47.089725 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.090795 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.091272 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.092098 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.092692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.093221 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.278732 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:47.287749 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a9375bdd-41a2-4ccc-97e3-4682c0c73253 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.228728 Aug 24 14:41:47.287749 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 213/402] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:47 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:47.302941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:47.312221 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7421f5b3-3977-4b96-9ee1-81fe4a2f21b3 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1313 microversion: 2.1 time: 0.237040 Aug 24 14:41:47.312802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 190/403] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:47 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:47.334851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:47.335932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:47.345344 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.345948 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.346429 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.347231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:47.347785 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:47.348297 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:47.490487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:47.499465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-6660943e-e835-4aed-a6ab-c23ecc925b19 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.168569 Aug 24 14:41:47.500362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 214/404] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:47 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:48.308355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:48.308969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:48.315945 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.316431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.316904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.317649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.318108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.318534 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.334164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:48.334778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:48.341476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.346413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.346413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.346413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.346413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.346810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.531983 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:48.542231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-039a9bcf-8dc9-421b-9999-935feb101df1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.237589 Aug 24 14:41:48.544234 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 191/405] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:48 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:48.548560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:48.549826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:48.556797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.557662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.557956 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.559008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.559379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.559907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.564412 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:48.574666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1ca83c77-5bea-4db3-95db-b3b7d2692b78 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1498 microversion: 2.1 time: 0.243740 Aug 24 14:41:48.576045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 215/406] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:48 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:48.712207 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:48.721060 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-814a2a44-fc64-4546-b655-51ddcdd1aaf1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.177174 Aug 24 14:41:48.721701 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 192/407] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:48 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:48.760665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-470c5598-4f3e-4d0e-9831-0c4b9c4a2962 req-b9420658-88f6-4893-be17-f1190b1638db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e279020f-8fbe-4e46-bbb0-a46e66e7bf5a", "tag": "acf35767-272d-4f99-b054-dfe40b43c477"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:48.772865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-470c5598-4f3e-4d0e-9831-0c4b9c4a2962 req-b9420658-88f6-4893-be17-f1190b1638db service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:48.773606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-470c5598-4f3e-4d0e-9831-0c4b9c4a2962 req-b9420658-88f6-4893-be17-f1190b1638db service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:48.775363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-470c5598-4f3e-4d0e-9831-0c4b9c4a2962 req-b9420658-88f6-4893-be17-f1190b1638db service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:48.788605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-470c5598-4f3e-4d0e-9831-0c4b9c4a2962 req-b9420658-88f6-4893-be17-f1190b1638db service nova] Creating event network-changed:acf35767-272d-4f99-b054-dfe40b43c477 for instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a on hv-cinder-75671 Aug 24 14:41:48.795140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-470c5598-4f3e-4d0e-9831-0c4b9c4a2962 req-b9420658-88f6-4893-be17-f1190b1638db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039064 Aug 24 14:41:48.795886 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 216/408] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:49.382106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-e98a29b6-b546-4f4a-955b-7cedf71eb29c req-db6b9de8-2dc3-4de2-9367-4bff659658b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7975e08b-1d91-48ec-a6c1-8f783b911af5", "name": "network-vif-plugged", "status": "completed", "tag": "91cf19ee-5586-4ad3-b92c-c90e8cfafa8d"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:49.394633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e98a29b6-b546-4f4a-955b-7cedf71eb29c req-db6b9de8-2dc3-4de2-9367-4bff659658b2 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:49.395148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e98a29b6-b546-4f4a-955b-7cedf71eb29c req-db6b9de8-2dc3-4de2-9367-4bff659658b2 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:49.395575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e98a29b6-b546-4f4a-955b-7cedf71eb29c req-db6b9de8-2dc3-4de2-9367-4bff659658b2 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.408409 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-e98a29b6-b546-4f4a-955b-7cedf71eb29c req-db6b9de8-2dc3-4de2-9367-4bff659658b2 service nova] Creating event network-vif-plugged:91cf19ee-5586-4ad3-b92c-c90e8cfafa8d for instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 on hv-cinder-75671 Aug 24 14:41:49.420680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-e98a29b6-b546-4f4a-955b-7cedf71eb29c req-db6b9de8-2dc3-4de2-9367-4bff659658b2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042949 Aug 24 14:41:49.423126 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 193/409] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:49.561899 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:49.566341 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:49.567034 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:49.573203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:49.573681 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:49.574141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.575336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:49.575988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:49.576546 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:49.593425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=8 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:49.719867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:49.728545 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-965dd92a-d695-4094-ab7c-b8079c5a2338 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.167535 Aug 24 14:41:49.729114 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 217/410] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:49 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:49.745667 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:49.747058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:49.763530 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:49.764330 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:49.764846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.765843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:49.766548 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:49.767042 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.774108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:49.774605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:49.781186 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:49.781674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:49.782152 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.783007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:49.785806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:49.785806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:49.810092 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:41:49.931396 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:49.940136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c04a605-f746-4922-b580-b45f67d687ed tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.200374 Aug 24 14:41:49.940723 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 194/411] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:49 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:50.151861 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e5692a75-4f8e-4c8f-b130-ef817f503fd6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "DELETE /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 204 len: 0 microversion: 2.1 time: 0.381906 Aug 24 14:41:50.152459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 218/412] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:41:49 2022] DELETE /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:41:50.160746 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:50.165124 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:50.167569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.168050 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.169092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.169805 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.170261 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.170682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.318669 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:50.326999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-af4ebfce-f10c-42cb-abe2-8d9992dc1051 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1504 microversion: 2.1 time: 0.170050 Aug 24 14:41:50.327585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 195/413] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:50 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:50.752307 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:50.753129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:50.759941 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.760505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.764745 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.764745 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.764745 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.764745 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.927170 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:50.936175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-291d750c-8b85-41cc-a607-f62baab30a03 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.188616 Aug 24 14:41:50.936771 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 219/414] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:50 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:50.962024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:50.962755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:50.965190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:50.970661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.971169 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.971596 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:50.972369 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:50.973002 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:50.973414 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.117140 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:51.126492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5146198c-8ca8-4f23-8642-97011cb64a40 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.167373 Aug 24 14:41:51.127176 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 196/415] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:50 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:51.348684 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:51.349291 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:51.356595 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.357164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.357858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.358611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.359108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.359573 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.514881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:51.523275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2797f057-d363-4982-9ce5-beaf75838b22 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1504 microversion: 2.1 time: 0.178370 Aug 24 14:41:51.523769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 220/416] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:51 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:51.957110 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:51.957734 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:51.963710 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.964304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.964594 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:51.965270 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:51.965904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:51.966315 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.114862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:52.124389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-82560ab1-17ef-4f37-908e-0f7cf9a3b4f8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.171025 Aug 24 14:41:52.124962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 197/417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:51 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:52.147423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:52.148028 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:52.154949 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.155435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.155868 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.156575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.157037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.157467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.311425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:52.319672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ffa5c529-8685-44cd-957f-d7a191aca144 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.176039 Aug 24 14:41:52.320261 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 221/418] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:52 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:52.546041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:52.547073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:52.553212 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.553687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.554145 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.554835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:52.555285 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:52.555693 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:52.702283 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:52.710351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ebf9fddf-79dd-4879-be4b-f458104a98dd tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1504 microversion: 2.1 time: 0.169069 Aug 24 14:41:52.710978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 198/419] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:52 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:53.146333 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:53.147042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:53.153743 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.154619 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.154619 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.155477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.155940 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.156366 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.292617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:53.301225 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dbc71a6f-09a3-493f-a250-2ac643d6ff0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.158883 Aug 24 14:41:53.301815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 222/420] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:53 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:53.340987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:53.342022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:53.348699 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.349252 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.349683 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.350454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.350933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.351358 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.487205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:53.500831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c5f41eb9-bdd6-4b1f-9c75-12ec7556dcc1 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.163875 Aug 24 14:41:53.501811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 199/421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:53 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:53.733027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:53.733550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:53.739481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.739953 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.740383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.741065 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:53.741514 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:53.741969 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:53.881627 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:53.889370 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cd1c1c9c-8f5b-401d-93ab-31d6408a9e14 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1504 microversion: 2.1 time: 0.160663 Aug 24 14:41:53.889970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 223/422] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:53 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:54.323148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:54.323932 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:54.331180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.331665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.332090 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.332780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.333252 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.333682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.469862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:54.477494 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3122dd9a-7266-492f-83de-69fb5d870290 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.158260 Aug 24 14:41:54.478097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 200/423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:54 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:54.531952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:54.532530 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:54.539673 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.540163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.540600 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.541305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.541778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.542209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.688979 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:54.697258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-97678133-5262-4dba-975a-91e8f84a59a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.169535 Aug 24 14:41:54.697864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 224/424] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:54 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:54.911339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:54.911945 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:54.918057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.919224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.919657 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:54.920334 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:54.920777 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:54.921193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:55.061339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:55.069721 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fca9f169-95cc-4e38-a6ec-9e42161b6bd9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1504 microversion: 2.1 time: 0.161973 Aug 24 14:41:55.070337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 201/425] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:54 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:55.499630 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:55.500259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:55.506450 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:55.506935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:55.507375 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:55.508079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:55.508533 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:55.509014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:55.670277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:55.680147 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f8b22fcf-21b4-4432-95cd-375b7fda3983 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1266 microversion: 2.1 time: 0.184142 Aug 24 14:41:55.680622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 225/426] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:55 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:55.728290 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:55.729156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:55.736310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:55.736790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:55.737223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:55.737954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:55.738399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:55.738803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:55.885379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:55.893980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1336ff33-811f-4560-9765-8b32928b0c0d tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.171248 Aug 24 14:41:55.894558 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 202/427] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:55 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:56.103785 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:56.104599 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:56.112783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.113272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.113717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.114459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.114919 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.115346 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.282417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:56.290581 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b26e2846-23bc-4cb0-9ab8-839316ea6a39 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1504 microversion: 2.1 time: 0.192559 Aug 24 14:41:56.291176 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 226/428] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:56 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:56.711340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:56.712337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:56.724570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.725548 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.726473 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.727821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.728801 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.729836 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.810093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-a6867dae-9283-433f-8b87-212fb7bb2d28 req-661051b6-382a-41bf-bb3f-85af48563751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63abd5d6-f857-4ef2-b91f-4c77e4470c03", "name": "network-vif-deleted", "tag": "ae57d99b-5421-474a-8ef3-618bf4d1ed88"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:56.821583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a6867dae-9283-433f-8b87-212fb7bb2d28 req-661051b6-382a-41bf-bb3f-85af48563751 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.822364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a6867dae-9283-433f-8b87-212fb7bb2d28 req-661051b6-382a-41bf-bb3f-85af48563751 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.824263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a6867dae-9283-433f-8b87-212fb7bb2d28 req-661051b6-382a-41bf-bb3f-85af48563751 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.838951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-a6867dae-9283-433f-8b87-212fb7bb2d28 req-661051b6-382a-41bf-bb3f-85af48563751 service nova] Creating event network-vif-deleted:ae57d99b-5421-474a-8ef3-618bf4d1ed88 for instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 on hv-cinder-75671 Aug 24 14:41:56.844922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-a6867dae-9283-433f-8b87-212fb7bb2d28 req-661051b6-382a-41bf-bb3f-85af48563751 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039173 Aug 24 14:41:56.845383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 227/429] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:41:56.907569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:56.916127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:56.916851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:56.921347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-788dc10f-c5ad-45a5-b97a-70a54cc4aad4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1454 microversion: 2.1 time: 0.221132 Aug 24 14:41:56.922402 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 203/430] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:56 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:56.926958 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.927880 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.932143 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.932143 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.932143 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.932143 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.947230 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:56.948042 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:56.955411 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.955887 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.956314 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:56.957000 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:56.957442 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:56.957883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.167643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:57.187083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8c646200-f701-438a-952e-313161cc8286 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.264393 Aug 24 14:41:57.187083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 228/431] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:56 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:57.187722 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:57.195506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-081bce53-2945-467e-9865-8c16100da3ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1454 microversion: 2.1 time: 0.252189 Aug 24 14:41:57.196092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 204/432] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:56 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1454 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:57.318814 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:57.320006 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:57.328020 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.328714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.329450 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.330361 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.330933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.331547 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.428493 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:57.438058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d3edccd1-8407-4655-a6bc-72737734b0fc tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1462 microversion: 2.1 time: 0.127808 Aug 24 14:41:57.438629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 229/433] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:57 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1462 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:57.501938 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:57.502760 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:57.533067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.533565 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.535050 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.536793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.538055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.538823 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.576832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3c819681-7509-433d-bf7b-915aa5066e81 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/ips" status: 200 len: 151 microversion: 2.20 time: 0.082873 Aug 24 14:41:57.577882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 205/434] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 24 14:41:57 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/ips => generated 151 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:41:57.870386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-db3aa571-d9aa-41e0-93e0-95448b9719c2 req-0cebb8c9-8238-49a1-9847-59a2aa594140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e279020f-8fbe-4e46-bbb0-a46e66e7bf5a", "name": "network-vif-plugged", "status": "completed", "tag": "acf35767-272d-4f99-b054-dfe40b43c477"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:57.886782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-db3aa571-d9aa-41e0-93e0-95448b9719c2 req-0cebb8c9-8238-49a1-9847-59a2aa594140 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:57.887550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-db3aa571-d9aa-41e0-93e0-95448b9719c2 req-0cebb8c9-8238-49a1-9847-59a2aa594140 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:57.888736 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-db3aa571-d9aa-41e0-93e0-95448b9719c2 req-0cebb8c9-8238-49a1-9847-59a2aa594140 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:57.904866 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-db3aa571-d9aa-41e0-93e0-95448b9719c2 req-0cebb8c9-8238-49a1-9847-59a2aa594140 service nova] Creating event network-vif-plugged:acf35767-272d-4f99-b054-dfe40b43c477 for instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a on hv-cinder-75671 Aug 24 14:41:57.915926 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-db3aa571-d9aa-41e0-93e0-95448b9719c2 req-0cebb8c9-8238-49a1-9847-59a2aa594140 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045560 Aug 24 14:41:57.915926 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 230/435] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:41:58.207395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:58.208332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:58.217444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.218156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.218690 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.219488 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.220437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.221200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.472328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:58.472804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:58.485131 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:58.493884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.495319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.496016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.497631 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.498458 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.499041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.506645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-946f9676-c595-4c6a-a756-49bbb0cd04b7 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.303559 Aug 24 14:41:58.513188 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 206/436] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:58 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:58.543121 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:58.545054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:58.545054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:58.545623 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lazy-loading 'fault' on Instance uuid 63abd5d6-f857-4ef2-b91f-4c77e4470c03 {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:41:58.617717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:58.635423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3bb3814e-65f6-4836-acf9-b28963f1de62 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 200 len: 1303 microversion: 2.1 time: 0.172077 Aug 24 14:41:58.636721 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 231/437] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:58 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 1303 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:41:59.552220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:59.553264 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:59.562526 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:59.563215 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:59.563817 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:59.564725 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:59.565300 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:59.565931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:59.589248 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:41:59.659678 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:41:59.660627 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: 63abd5d6-f857-4ef2-b91f-4c77e4470c03] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:41:59.667717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:59.668494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:59.669045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:59.669970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:41:59.670576 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:41:59.671138 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:41:59.689046 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] HTTP exception thrown: Instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 could not be found. Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Request method failure captured: Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 HTTP/1.1 Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjiOxiLMbbNvK1vqcCVEaiJAIngkFXmN3U5jR6Z4puthufOr1SZcfkgU8vs3t4vGyHYkykmNweyTlD3WGYKLIOciGA_mFX8UAZrgsTXexCzVOQYR6Rccj5V5p94eYYy6IiEZBOZZMiXnAoG8n8U9a5y2CV9gZajnna7Ea9F6nfuaC0o Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: f69f30ea5d3642c28a38c6f75c8bb57b Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-VolumesActionsTest-1264346614 Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:41:59.690901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f69f30ea5d3642c28a38c6f75c8bb57b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f69f30ea5d3642c28a38c6f75c8bb57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f69f30ea5d3642c28a38c6f75c8bb57b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f69f30ea5d3642c28a38c6f75c8bb57b"}]}] Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-VolumesActionsTest-1264346614 Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: f69f30ea5d3642c28a38c6f75c8bb57b Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-VolumesActionsTest-1264346614 Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-VolumesActionsTest-1264346614-project Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: a902794de84d477e890e0e6a861c102d Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-VolumesActionsTest-1264346614-project Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 could not be found. Aug 24 14:41:59.693588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '63abd5d6-f857-4ef2-b91f-4c77e4470c03'} Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 could not be found. Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:41:59.695477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 could not be found. Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 could not be found. Aug 24 14:41:59.697915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:41:59.700651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Returning 404 to user: Instance 63abd5d6-f857-4ef2-b91f-4c77e4470c03 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:41:59.700651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7fd7040f-c5c6-4e81-8840-ed5bf468a6eb tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03" status: 404 len: 111 microversion: 2.1 time: 0.039390 Aug 24 14:41:59.700651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 232/438] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:59 2022] GET /compute/v2.1/servers/63abd5d6-f857-4ef2-b91f-4c77e4470c03 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:41:59.791257 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:41:59.814471 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b46f68f1-6d15-44b8-81ee-dfd9407e3df9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.266916 Aug 24 14:41:59.815482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 207/439] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:41:59 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:41:59.867066 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-465713738", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "networks": [{"uuid": "98041d2c-8006-493f-9a5d-db66e17a9b0b"}]}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:41:59.932308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] validate_networks() for [('98041d2c-8006-493f-9a5d-db66e17a9b0b', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:42:00.441912 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:42:00.445865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:42:00.445865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:42:00.445865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:42:00.445865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:42:00.467583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.468667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.469309 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.471178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.471496 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.472208 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.491235 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-4a4f6060-d9ca-4870-8698-ffa30ae2c5ec req-d1f55663-0713-427c-8d69-117d0e138502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7975e08b-1d91-48ec-a6c1-8f783b911af5", "tag": "91cf19ee-5586-4ad3-b92c-c90e8cfafa8d"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:00.508525 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4a4f6060-d9ca-4870-8698-ffa30ae2c5ec req-d1f55663-0713-427c-8d69-117d0e138502 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.509373 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4a4f6060-d9ca-4870-8698-ffa30ae2c5ec req-d1f55663-0713-427c-8d69-117d0e138502 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.509702 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Getting quotas for project f69f30ea5d3642c28a38c6f75c8bb57b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:42:00.510167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4a4f6060-d9ca-4870-8698-ffa30ae2c5ec req-d1f55663-0713-427c-8d69-117d0e138502 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.517878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Getting quotas for user a902794de84d477e890e0e6a861c102d and project f69f30ea5d3642c28a38c6f75c8bb57b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:42:00.530642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-4a4f6060-d9ca-4870-8698-ffa30ae2c5ec req-d1f55663-0713-427c-8d69-117d0e138502 service nova] Creating event network-changed:91cf19ee-5586-4ad3-b92c-c90e8cfafa8d for instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 on hv-cinder-75671 Aug 24 14:42:00.532315 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:42:00.535557 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:42:00.540552 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-4a4f6060-d9ca-4870-8698-ffa30ae2c5ec req-d1f55663-0713-427c-8d69-117d0e138502 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056019 Aug 24 14:42:00.542341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 208/440] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:00.591192 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:00.725608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-24c979a4-500f-484b-8698-b7516cc27812 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862454 Aug 24 14:42:00.727121 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 233/441] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:41:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:42:00.750132 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cc5b1ff8-3c48-44ec-bb51-e226e8dff2d4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:00.752467 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cc5b1ff8-3c48-44ec-bb51-e226e8dff2d4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:00.843824 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:00.844912 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:00.856791 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.857505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.858482 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.859885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:00.860508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cc5b1ff8-3c48-44ec-bb51-e226e8dff2d4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:00.861084 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:00.862026 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:00.881393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cc5b1ff8-3c48-44ec-bb51-e226e8dff2d4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1213 microversion: 2.1 time: 0.140867 Aug 24 14:42:00.882820 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 209/442] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:00 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:00.897626 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:01.104711 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:01.115322 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1a5b9d91-7dcd-4429-a28b-bde0b3cc1725 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1315 microversion: 2.1 time: 0.279762 Aug 24 14:42:01.125394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 234/443] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:00 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:01.144799 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:01.146403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:01.162065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.163487 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.164993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.167009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.169319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.170624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.227764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lazy-loading 'flavor' on Instance uuid 687c842a-2354-49c5-9c12-165babf4a0d6 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:42:01.695383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:01.696257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:01.723416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.723416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.723416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.723416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:01.724082 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:01.724434 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:01.781266 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-32b95843-e279-42b6-9744-504e583f3790 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/ips" status: 200 len: 145 microversion: 2.1 time: 0.094080 Aug 24 14:42:01.793821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 235/444] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:42:01 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/ips => generated 145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:42:01.917310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a4e6815c-030a-4e2d-ba8b-3ed5180beac7 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:01.918589 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a4e6815c-030a-4e2d-ba8b-3ed5180beac7 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.027876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-01fdf713-c8ba-41ce-a697-78f3c3115523 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/action" status: 202 len: 0 microversion: 2.20 time: 0.890879 Aug 24 14:42:02.034532 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 210/445] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 24 14:42:01 2022] POST /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:42:02.034770 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a4e6815c-030a-4e2d-ba8b-3ed5180beac7 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.060199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a4e6815c-030a-4e2d-ba8b-3ed5180beac7 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1213 microversion: 2.1 time: 0.144973 Aug 24 14:42:02.063652 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 236/446] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:01 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1213 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:02.076631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:02.077622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.094375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.095499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.096324 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.097503 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.098278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.098962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.151640 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:02.152264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.161796 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.162303 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.162780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.163531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.164001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.166906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.452284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.472338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.474887 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.475143 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:02.476863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c7ace601-92a1-45e8-a4ed-89d6a952aa36 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.429229 Aug 24 14:42:02.478539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 211/447] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:02 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:02.494233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-419c4937-01c7-4362-8724-6b66d0f82530 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1465 microversion: 2.1 time: 0.345930 Aug 24 14:42:02.495380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 237/448] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:02 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1465 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:02.587572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:02.588247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:02.596220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.596986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.597908 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.598728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:02.599354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:02.599924 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:02.632084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:42:03.026855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2d8ac63d-4908-4fd9-99f4-dc121fd9b9e0 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 204 len: 0 microversion: 2.1 time: 0.442913 Aug 24 14:42:03.028377 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 212/449] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:42:02 2022] DELETE /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:42:03.042232 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:03.043444 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:03.052982 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.053815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.054838 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.056052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.056848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.057588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.096326 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:03.097563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:03.108545 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.109381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.110144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.111360 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.112159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.112743 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.254693 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:03.268782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-97d54299-08ad-4d48-b3d8-da768830a54b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1265 microversion: 2.1 time: 0.180437 Aug 24 14:42:03.270948 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 213/450] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:03 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:03.331717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:03.346209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-215777d1-4900-447d-b216-b3ca48e8d4a4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1471 microversion: 2.1 time: 0.310838 Aug 24 14:42:03.347270 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 238/451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:03 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:03.513167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:03.514022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:03.524236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.525150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.525988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.527274 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:03.528738 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:03.529701 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:03.700731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:03.714787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:03.717816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:03.719884 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2f22b35a-2dc7-416d-bce7-c599ab052332 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.211592 Aug 24 14:42:03.720803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 214/452] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:03 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:04.295783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:04.296381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:04.303137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:04.303661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:04.304136 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.304903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:04.305397 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:04.306096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.375525 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.381323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:04.382392 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:04.390881 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:04.393400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b72b1937-de1c-47d2-beaf-5f7b36c5cf9c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1265 microversion: 2.1 time: 0.099459 Aug 24 14:42:04.393583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:04.393583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.394065 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 239/453] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:04 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:04.394231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:04.394231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:04.394231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.587062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.596233 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b4ca8d73-4957-4618-a643-0ce5210c111b tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1471 microversion: 2.1 time: 0.219288 Aug 24 14:42:04.596863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 215/454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:04 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:04.754563 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:04.755185 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:04.765014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:04.765955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:04.766718 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.767935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:04.768744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:04.769531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:04.970631 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.985468 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.988498 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:04.990623 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e79cc809-4169-4369-aeb3-4a0cbe10e775 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.239960 Aug 24 14:42:04.991589 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 240/455] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:04 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:05.420375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:05.421501 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:05.430613 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.431322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.432155 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.433184 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.434045 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.434692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.568368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:05.580347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b31351b1-e2d6-4752-b4c0-67b56c8162e9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1273 microversion: 2.1 time: 0.168423 Aug 24 14:42:05.581560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 216/456] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:05 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:05.646128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:05.646128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:05.654714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.655598 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.657909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.659673 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.660468 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.661161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.703287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2991c5a-6054-46d9-a124-b253a17db473"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:05.707086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:05.722338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.726029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.726029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.726029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:05.726029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:05.726684 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:05.908206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:05.921694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b149836e-5437-45c0-b975-1f6de72ebbe4 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1471 microversion: 2.1 time: 0.293811 Aug 24 14:42:05.922778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 241/457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:05 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:06.034469 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.035950 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:06.048967 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.050435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.051424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.052980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.054134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.055219 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.430384 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:06.446988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:06.462085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:06.465061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ced7a8df-66eb-47fa-b0a5-ebde3e27536c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.437993 Aug 24 14:42:06.466488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 242/458] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:06 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:06.475583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-2e88e403-59e6-4c05-8837-9f5b72ebd3d0 req-05b60f30-f2ca-4120-9c4e-2720369b4109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e279020f-8fbe-4e46-bbb0-a46e66e7bf5a", "name": "network-vif-deleted", "tag": "acf35767-272d-4f99-b054-dfe40b43c477"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:06.496596 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2e88e403-59e6-4c05-8837-9f5b72ebd3d0 req-05b60f30-f2ca-4120-9c4e-2720369b4109 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.497874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2e88e403-59e6-4c05-8837-9f5b72ebd3d0 req-05b60f30-f2ca-4120-9c4e-2720369b4109 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.498960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2e88e403-59e6-4c05-8837-9f5b72ebd3d0 req-05b60f30-f2ca-4120-9c4e-2720369b4109 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.529408 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-2e88e403-59e6-4c05-8837-9f5b72ebd3d0 req-05b60f30-f2ca-4120-9c4e-2720369b4109 service nova] Creating event network-vif-deleted:acf35767-272d-4f99-b054-dfe40b43c477 for instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a on hv-cinder-75671 Aug 24 14:42:06.542488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-2e88e403-59e6-4c05-8837-9f5b72ebd3d0 req-05b60f30-f2ca-4120-9c4e-2720369b4109 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073398 Aug 24 14:42:06.545287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 243/459] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:06.623909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.625527 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:06.637247 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.638970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.639747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.641151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.641937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.642928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.848308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:06.861241 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4ce35b44-c99e-4b60-ae48-f898b211f878 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.248435 Aug 24 14:42:06.862280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 244/460] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:06 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:06.890296 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-766b2074-b610-40f3-afbc-19165058f3fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193968 Aug 24 14:42:06.891142 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 217/461] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:42:05 2022] POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/os-volume_attachments => generated 194 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:42:06.951948 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:06.952619 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:06.958929 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.959404 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.960105 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:06.960797 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:06.961420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:06.961865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.022826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.023661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.024412 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.025187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lazy-loading 'fault' on Instance uuid e279020f-8fbe-4e46-bbb0-a46e66e7bf5a {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:42:07.085288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9beccc8676245ec8082032efcb19ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b55635cff7462ba4702b7b1600406d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:07.099444 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-002aba17-f42a-4733-976f-e5d5f511c3c9 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 200 len: 1305 microversion: 2.1 time: 0.151383 Aug 24 14:42:07.100711 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 245/462] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:06 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 1305 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:07.514725 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:07.520770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:07.550712 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.552414 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.553865 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.555794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.557806 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.560022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.663968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-11a62379-67d4-4c97-b3db-7ad690c98353 req-e4db118c-93d5-4d7d-ad3f-b2a16d9eae9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14ac1cb-fbdc-4477-9270-baa3caf4c834", "tag": "2f676a6f-ae72-463f-b5d2-88c0c603f3e7"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:07.684918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-11a62379-67d4-4c97-b3db-7ad690c98353 req-e4db118c-93d5-4d7d-ad3f-b2a16d9eae9e service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.686908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-11a62379-67d4-4c97-b3db-7ad690c98353 req-e4db118c-93d5-4d7d-ad3f-b2a16d9eae9e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.687687 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-11a62379-67d4-4c97-b3db-7ad690c98353 req-e4db118c-93d5-4d7d-ad3f-b2a16d9eae9e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.722940 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-11a62379-67d4-4c97-b3db-7ad690c98353 req-e4db118c-93d5-4d7d-ad3f-b2a16d9eae9e service nova] Creating event network-changed:2f676a6f-ae72-463f-b5d2-88c0c603f3e7 for instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 on hv-cinder-75671 Aug 24 14:42:07.732368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-11a62379-67d4-4c97-b3db-7ad690c98353 req-e4db118c-93d5-4d7d-ad3f-b2a16d9eae9e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076233 Aug 24 14:42:07.734129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 246/463] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:07.868510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:07.887866 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:07.894897 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:07.896527 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:07.896527 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:07.897282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-50670227-3be0-4ff4-94ae-e7c0cc655723 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.388688 Aug 24 14:42:07.897282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 218/464] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:07 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:07.905106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.906452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.907252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:07.908579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:07.909053 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:07.909484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.138345 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.139686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] [instance: e279020f-8fbe-4e46-bbb0-a46e66e7bf5a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:08.149341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.150159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.150828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.151925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.154735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.154735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.179265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] HTTP exception thrown: Instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a could not be found. Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Request method failure captured: Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a HTTP/1.1 Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjier_W4ewB7160QT1t_rE3N5kBxFFE7qlPEWZIQZDDGaK_3UK1lPi2aX8ZfT8c3T4Z32jt_kKpAm1vh8JRxGejLnxQdu7yFwMdOrwEov-GXVTY6uWA673mNVfP8SZiOFXoOBsWsLxpUqY3KAe1RdzUHWT1jRMW52yE0MC0faNWh1vk Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 96b55635cff7462ba4702b7b1600406d Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesNegativeTest-440663309 Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:42:08.185800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/96b55635cff7462ba4702b7b1600406d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_96b55635cff7462ba4702b7b1600406d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/96b55635cff7462ba4702b7b1600406d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/96b55635cff7462ba4702b7b1600406d"}]}] Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesNegativeTest-440663309 Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 96b55635cff7462ba4702b7b1600406d Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesNegativeTest-440663309 Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesNegativeTest-440663309-project Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: b9beccc8676245ec8082032efcb19ef6 Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesNegativeTest-440663309-project Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a could not be found. Aug 24 14:42:08.191192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'e279020f-8fbe-4e46-bbb0-a46e66e7bf5a'} Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a could not be found. Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:08.192508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a could not be found. Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a could not be found. Aug 24 14:42:08.194626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:42:08.196517 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] Returning 404 to user: Instance e279020f-8fbe-4e46-bbb0-a46e66e7bf5a could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:08.196517 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-702b8258-a855-44bd-b608-3c32597e2239 tempest-VolumesNegativeTest-440663309 tempest-VolumesNegativeTest-440663309-project] 10.222.0.65 "GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a" status: 404 len: 111 microversion: 2.1 time: 0.057021 Aug 24 14:42:08.196517 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 219/465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:08 2022] GET /compute/v2.1/servers/e279020f-8fbe-4e46-bbb0-a46e66e7bf5a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:42:08.222001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:08.237720 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4d642e6a-70f9-4f24-b640-0a82f4baf8a6 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.354739 Aug 24 14:42:08.238614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 247/466] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:07 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:08.932602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:08.933615 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:08.944387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.945174 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.945893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:08.947022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:08.947791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:08.948465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.204704 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:09.217205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:09.218949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:09.220223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dac70cc6-092c-4c29-ab5c-4185576189ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.294912 Aug 24 14:42:09.234604 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 220/467] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:08 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:09.271366 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:09.272502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:09.283546 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.284153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.284691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.285955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:09.286585 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:09.287114 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:09.732305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:09.748012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f0ab030a-8e4b-469d-b606-f17a5bf54c48 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.485818 Aug 24 14:42:09.748972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 248/468] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:09 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:10.262877 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:10.263971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:10.275172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.276035 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.276791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.278872 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.279714 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.280455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.312752 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:10.475087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:10.492862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:10.495839 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:10.498086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-45f01304-36e6-49c5-a3a6-6b2bbecd360b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.240958 Aug 24 14:42:10.499067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 221/469] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:10 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:10.782719 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:10.783860 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:10.786740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:10.791889 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.792376 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.792808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.794135 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:10.794582 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:10.795004 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:10.962265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:10.974067 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d8f5b38e-d1ac-4af8-93b2-047d723fcae4 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.199552 Aug 24 14:42:10.980557 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 249/470] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:10 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:11.530850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:11.531627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:11.534550 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:11.548053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:11.548053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:11.548053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:11.548053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:11.548660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:11.548660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:11.750198 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:11.760034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:11.761741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:11.763458 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f63c175a-301f-470e-8799-b884c46e79af tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.240814 Aug 24 14:42:11.764194 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 222/471] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:11 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:12.008926 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:12.009651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:12.016022 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:12.016508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:12.016940 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:12.020788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:12.020788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:12.020788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:12.041915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=8 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:12.181716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:12.191536 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7c5c7efe-a3aa-4685-acf3-83fc3c5aee79 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.186728 Aug 24 14:42:12.192364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 250/472] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:12 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:12.804476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:12.805768 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:12.823888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:12.824489 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:12.825242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:12.825988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:12.826437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:12.826857 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:13.027959 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:13.036855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:13.038386 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:13.039563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bdf5952d-5fa5-42c8-bc77-57425b7b3273 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.242481 Aug 24 14:42:13.040124 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 223/473] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:12 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:13.224882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:13.225708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:13.232256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:13.235927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:13.235927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:13.235927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:13.235927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:13.236631 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:13.423928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:13.443175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-02592d50-688d-46ec-a0ca-d9228cb89f05 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.217496 Aug 24 14:42:13.443832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 251/474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:13 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:14.079121 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:14.080204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:14.084051 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:14.092835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.093777 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.094699 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.095795 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.096602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.097371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.293298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:14.311931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:14.314519 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:14.316482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-923def2d-2569-4cb6-92f9-342aedceea70 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.245098 Aug 24 14:42:14.317399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 224/475] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:14 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:14.486639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:14.487627 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:14.499614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.500486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.501251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.502597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:14.506494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:14.506494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:14.720777 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:14.735217 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b0dba2e9-6d57-4c8b-9b92-5676e0a90b6c tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.256298 Aug 24 14:42:14.736196 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 252/476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:14 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:15.354016 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:15.354854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:15.363819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.364352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.364822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:15.365619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.366170 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.366627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:15.566262 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:15.578490 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:15.588896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:15.588896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1cff7620-2dcd-48b6-8ecb-702ef90f110f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1742 microversion: 2.20 time: 0.232519 Aug 24 14:42:15.588896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 225/477] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:15 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1742 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:15.756553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:15.757149 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:15.764798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.765300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.765738 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:15.766504 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:15.767096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:15.767381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:15.789421 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:15.974371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:15.988086 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0eced655-3f5c-4738-b2bd-a87fd1ae0c2d tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.235259 Aug 24 14:42:15.990063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 253/478] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:15 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:16.543840 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-98599117-8a31-4ebb-b595-8af874c82fb7 req-c3435d77-4ec4-4391-bb9f-af032a35b027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14ac1cb-fbdc-4477-9270-baa3caf4c834", "name": "network-vif-plugged", "status": "completed", "tag": "2f676a6f-ae72-463f-b5d2-88c0c603f3e7"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:16.559990 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-98599117-8a31-4ebb-b595-8af874c82fb7 req-c3435d77-4ec4-4391-bb9f-af032a35b027 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:16.560666 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-98599117-8a31-4ebb-b595-8af874c82fb7 req-c3435d77-4ec4-4391-bb9f-af032a35b027 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:16.561415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-98599117-8a31-4ebb-b595-8af874c82fb7 req-c3435d77-4ec4-4391-bb9f-af032a35b027 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:16.585136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-98599117-8a31-4ebb-b595-8af874c82fb7 req-c3435d77-4ec4-4391-bb9f-af032a35b027 service nova] Creating event network-vif-plugged:2f676a6f-ae72-463f-b5d2-88c0c603f3e7 for instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 on hv-cinder-75671 Aug 24 14:42:16.595071 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-98599117-8a31-4ebb-b595-8af874c82fb7 req-c3435d77-4ec4-4391-bb9f-af032a35b027 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058094 Aug 24 14:42:16.596276 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 226/479] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:16.612605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:16.613225 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:16.622162 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:16.623781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:16.623781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:16.624980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:16.625695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:16.626372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:16.895721 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:16.910674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:16.911584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-02e9a62f-b49a-4f1b-9c47-17ec497bc5c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:16.913599 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:16.916058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-991b8c4d-38c1-4951-b1b9-d77080d23f02 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1742 microversion: 2.20 time: 0.307345 Aug 24 14:42:16.917086 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 254/480] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:16 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1742 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:16.921918 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02e9a62f-b49a-4f1b-9c47-17ec497bc5c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:16.922624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02e9a62f-b49a-4f1b-9c47-17ec497bc5c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:16.923143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02e9a62f-b49a-4f1b-9c47-17ec497bc5c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:16.994921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-02e9a62f-b49a-4f1b-9c47-17ec497bc5c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Going to try to stop instance {{(pid=132892) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 14:42:17.025366 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:17.026461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:17.036459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.037208 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.037899 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.039047 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.039746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.040397 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.250334 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:17.259636 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-31519809-7aca-4295-88c5-8dbb20705fcf tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.242311 Aug 24 14:42:17.260855 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 255/481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:17 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:17.319153 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-02e9a62f-b49a-4f1b-9c47-17ec497bc5c2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/action" status: 202 len: 0 microversion: 2.1 time: 0.412496 Aug 24 14:42:17.322855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 227/482] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:42:16 2022] POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:42:17.328865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:17.329918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:17.338152 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.338700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.339140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.340095 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.340559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.340985 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.512726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:17.521779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c82becf4-d59e-4b36-a588-12aebaa661ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.197007 Aug 24 14:42:17.522390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 256/483] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:17 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:17.962696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:17.963937 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:17.973641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.974499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.975253 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:17.976391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:17.977172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:17.977931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.149921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.160871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.163278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.165669 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1365bac2-35d7-40a0-b3e4-9bfb8aa980ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1742 microversion: 2.20 time: 0.211716 Aug 24 14:42:18.166376 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 228/484] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:17 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1742 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:18.290867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:18.291963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:18.302626 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:18.303115 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:18.303549 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.304246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:18.304701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:18.305119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.505780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.514847 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7f87298a-fc1f-406c-85bf-9d1ed5017f0e tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.229869 Aug 24 14:42:18.515435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 257/485] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:18 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:18.546306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:18.546950 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:18.553339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:18.553858 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:18.554393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.555123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:18.555553 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:18.556001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:18.724787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:18.734240 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a4556210-1bd8-41c9-84db-2d8dbef4b393 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.193938 Aug 24 14:42:18.734601 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 229/486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:18 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:19.193476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:19.194652 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:19.201209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.201702 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.202175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:19.202893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.203351 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.203771 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:19.379495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:19.390471 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:19.393046 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:19.394901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-002d6be5-86a0-4be0-9566-93084cdcd898 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1742 microversion: 2.20 time: 0.208061 Aug 24 14:42:19.395814 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 258/487] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:19 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:19.540745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:19.542130 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:19.552305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.552831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.553347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:19.554217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.554868 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.555641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:19.757706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:19.760355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:19.761807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:19.771393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0c7b4287-8b96-4bea-9df5-be0879b0980a tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1313 microversion: 2.1 time: 0.236056 Aug 24 14:42:19.771650 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.771794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 230/488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:19 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:19.771925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.771925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:19.772206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:19.772675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:19.773110 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:19.937532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:19.952359 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b52ac629-be24-4c0f-aa78-0f1480153fae tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.200457 Aug 24 14:42:19.952975 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 259/489] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:19 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:20.427697 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:20.428396 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:20.435536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:20.436133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:20.436954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:20.438164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:20.438703 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:20.439205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:20.461283 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-79f2c89b-12e4-45a6-9545-9af92a47d19f req-e481b879-124c-4a6e-84cb-8f2995000980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687c842a-2354-49c5-9c12-165babf4a0d6", "name": "network-vif-plugged", "status": "completed", "tag": "e937f76f-4ef7-4572-b805-b6918a000637"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:20.476536 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-79f2c89b-12e4-45a6-9545-9af92a47d19f req-e481b879-124c-4a6e-84cb-8f2995000980 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:20.484289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-79f2c89b-12e4-45a6-9545-9af92a47d19f req-e481b879-124c-4a6e-84cb-8f2995000980 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:20.484289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-79f2c89b-12e4-45a6-9545-9af92a47d19f req-e481b879-124c-4a6e-84cb-8f2995000980 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:20.492741 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-79f2c89b-12e4-45a6-9545-9af92a47d19f req-e481b879-124c-4a6e-84cb-8f2995000980 service nova] Creating event network-vif-plugged:e937f76f-4ef7-4572-b805-b6918a000637 for instance 687c842a-2354-49c5-9c12-165babf4a0d6 on hv-cinder-75671 Aug 24 14:42:20.498981 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-79f2c89b-12e4-45a6-9545-9af92a47d19f req-e481b879-124c-4a6e-84cb-8f2995000980 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043184 Aug 24 14:42:20.501262 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 260/490] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:20.645658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:20.659301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:20.662279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:20.664165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1a61e13b-b579-46ce-8d6d-417dabe108d8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1742 microversion: 2.20 time: 0.241225 Aug 24 14:42:20.664833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 231/491] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:20 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:20.798875 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:20.800068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:20.810120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:20.810917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:20.811633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:20.812770 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:20.813420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:20.813885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:20.965501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:20.974167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:20.974778 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:20.976505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-19b11235-1fb3-4b71-8b61-c39c4a25037f tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1497 microversion: 2.1 time: 0.186475 Aug 24 14:42:20.977131 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 261/492] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:20 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:20.981872 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:20.982360 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:20.982797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:20.983497 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:20.983943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:20.984364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:21.188910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:21.200076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1c333bb2-6e9d-4db4-b486-5dc8dede832e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.229787 Aug 24 14:42:21.200661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 232/493] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:20 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:21.691444 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:21.692176 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:21.700332 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:21.700613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:21.700917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:21.701712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:21.702285 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:21.702748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:21.851397 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:21.864683 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:21.866209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:21.867481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5a1c812a-a175-4090-bb6a-d57fde4ff9df tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1742 microversion: 2.20 time: 0.180255 Aug 24 14:42:21.868052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 262/494] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:21 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:22.009260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:22.010364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:22.020069 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.020596 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.021041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.021789 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.022248 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.022671 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.049743 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:42:22.231939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:22.231939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:22.235180 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.235906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.236613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.237355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.237852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.238289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.343927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f25e66d-2e59-43da-a3c2-c883067a5351 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 204 len: 0 microversion: 2.1 time: 0.341307 Aug 24 14:42:22.344651 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 233/495] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:42:22 2022] DELETE /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:42:22.353349 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:22.354089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:22.361110 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.361600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.362051 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.362754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.363198 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.363622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.428425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:22.438546 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ee897fa4-21d5-4fc9-b536-0cc7e04c3701 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.219050 Aug 24 14:42:22.439145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 263/496] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:22 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:22.524996 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:22.533099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-97c97416-af1a-422f-b90c-384e67ce0b37 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1503 microversion: 2.1 time: 0.183839 Aug 24 14:42:22.533672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 234/497] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:22 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:22.893127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:22.893862 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:22.901364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.901875 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.902633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:22.903486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:22.903937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:22.904366 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:23.048419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:23.057048 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:23.059235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:23.060369 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-76deed29-7e79-4cfd-a56f-5d93741de6e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1742 microversion: 2.20 time: 0.171355 Aug 24 14:42:23.060942 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 264/498] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:22 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:23.469106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:23.470172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:23.483412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:23.483895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:23.484455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:23.485160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:23.485616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:23.486066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:23.557025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:23.557640 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:23.563829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:23.564314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:23.564749 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:23.565455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:23.565964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:23.566382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:23.733788 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:23.745328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4414bff1-c57d-44c5-9f33-de0c6190b090 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.281036 Aug 24 14:42:23.746764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 235/499] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:23 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:23.765075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:23.779307 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-fac29e29-ac7b-47ae-ac7b-e73ffb0e829b tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1503 microversion: 2.1 time: 0.226486 Aug 24 14:42:23.780195 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 265/500] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:23 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:24.083846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:24.084510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:24.091801 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:24.092282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:24.092705 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:24.093629 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:24.094116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:24.094808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:24.101039 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:24.250939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:24.260260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:24.263580 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:24.264961 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c4440d51-fdcd-42d7-b738-d6596632d0d2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.185105 Aug 24 14:42:24.265816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 236/501] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:24 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:24.778194 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:24.779372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:24.787484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:24.788146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:24.788740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:24.789710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:24.790518 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:24.791222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:24.814140 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:24.814799 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:24.833425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:24.833425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:24.833425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:24.834249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:24.834249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:24.834519 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:25.004873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:25.021734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e79bb633-39fb-4592-bd7b-895092f90781 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.250648 Aug 24 14:42:25.023246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 266/502] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:24 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:25.050602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:25.068553 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5d623ba8-5b3d-485a-8c7a-662dac36fd55 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1503 microversion: 2.1 time: 0.260436 Aug 24 14:42:25.069832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 237/503] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:24 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:25.203594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-a328bd49-e164-4203-958a-07a776bdc419 req-e9485e2e-9b80-4772-b006-cbd4f43e6d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14ac1cb-fbdc-4477-9270-baa3caf4c834", "name": "network-vif-deleted", "tag": "2f676a6f-ae72-463f-b5d2-88c0c603f3e7"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:25.224596 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a328bd49-e164-4203-958a-07a776bdc419 req-e9485e2e-9b80-4772-b006-cbd4f43e6d6d service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:25.224962 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a328bd49-e164-4203-958a-07a776bdc419 req-e9485e2e-9b80-4772-b006-cbd4f43e6d6d service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:25.225394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a328bd49-e164-4203-958a-07a776bdc419 req-e9485e2e-9b80-4772-b006-cbd4f43e6d6d service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:25.238272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-a328bd49-e164-4203-958a-07a776bdc419 req-e9485e2e-9b80-4772-b006-cbd4f43e6d6d service nova] Creating event network-vif-deleted:2f676a6f-ae72-463f-b5d2-88c0c603f3e7 for instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 on hv-cinder-75671 Aug 24 14:42:25.244856 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-a328bd49-e164-4203-958a-07a776bdc419 req-e9485e2e-9b80-4772-b006-cbd4f43e6d6d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049465 Aug 24 14:42:25.246709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 267/504] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:25.291241 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:25.292001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:25.299033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:25.299527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:25.300249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:25.300941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:25.301490 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:25.302122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:25.482891 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:25.506797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:25.517099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:25.519737 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fd84aad9-5bac-47bb-b97c-f22f5c9c7daf tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.233337 Aug 24 14:42:25.520868 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 238/505] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:25 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:26.056374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:26.058118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:26.071774 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.072263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.072968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.074638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.075397 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.076663 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.117704 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:26.124222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:26.158421 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.159604 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.162461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.163659 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.164533 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.165208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.227445 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.228240 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.228891 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.229639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lazy-loading 'fault' on Instance uuid e14ac1cb-fbdc-4477-9270-baa3caf4c834 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:42:26.312280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a902794de84d477e890e0e6a861c102d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69f30ea5d3642c28a38c6f75c8bb57b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:26.329662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5a1a51dd-6f17-4a5c-ac97-6c8efded50b9 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 200 len: 1303 microversion: 2.1 time: 0.235588 Aug 24 14:42:26.353814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 239/506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:26 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 1303 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:26.362552 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:26.396226 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c79eda3f-d86b-494f-bb3c-de90d33fc5b2 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.353076 Aug 24 14:42:26.397409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 268/507] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:26 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:26.556461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:26.558037 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:26.577255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.578465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.579191 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.580400 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:26.581064 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:26.581848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:26.781422 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:26.796807 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:26.798882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:26.801942 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-972ccc6c-6a63-460c-956a-5b7ccdf16283 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.251227 Aug 24 14:42:26.802774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 240/508] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:26 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:27.356891 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:27.357850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] [instance: e14ac1cb-fbdc-4477-9270-baa3caf4c834] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:27.370426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:27.372276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:27.373725 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:27.375246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:27.376674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:27.377435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:27.396916 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] HTTP exception thrown: Instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 could not be found. Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Request method failure captured: Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 HTTP/1.1 Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjiOxiLMbbNvK1vqcCVEaiJAIngkFXmN3U5jR6Z4puthufOr1SZcfkgU8vs3t4vGyHYkykmNweyTlD3WGYKLIOciGA_mFX8UAZrgsTXexCzVOQYR6Rccj5V5p94eYYy6IiEZBOZZMiXnAoG8n8U9a5y2CV9gZajnna7Ea9F6nfuaC0o Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: f69f30ea5d3642c28a38c6f75c8bb57b Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-VolumesActionsTest-1264346614 Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:42:27.398707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f69f30ea5d3642c28a38c6f75c8bb57b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f69f30ea5d3642c28a38c6f75c8bb57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f69f30ea5d3642c28a38c6f75c8bb57b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f69f30ea5d3642c28a38c6f75c8bb57b"}]}] Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-VolumesActionsTest-1264346614 Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: f69f30ea5d3642c28a38c6f75c8bb57b Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-VolumesActionsTest-1264346614 Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-VolumesActionsTest-1264346614-project Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: a902794de84d477e890e0e6a861c102d Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-VolumesActionsTest-1264346614-project Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 could not be found. Aug 24 14:42:27.401986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'e14ac1cb-fbdc-4477-9270-baa3caf4c834'} Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 could not be found. Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:42:27.402724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 could not be found. Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 could not be found. Aug 24 14:42:27.404078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:42:27.405159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] Returning 404 to user: Instance e14ac1cb-fbdc-4477-9270-baa3caf4c834 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:42:27.405159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-99200d6f-930b-485a-bc75-78fa6af7fd75 tempest-VolumesActionsTest-1264346614 tempest-VolumesActionsTest-1264346614-project] 10.222.0.65 "GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834" status: 404 len: 111 microversion: 2.1 time: 0.050965 Aug 24 14:42:27.405159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 269/509] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:27 2022] GET /compute/v2.1/servers/e14ac1cb-fbdc-4477-9270-baa3caf4c834 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:42:27.435420 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:27.436036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:27.444839 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:27.445694 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:27.446325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:27.447907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:27.448803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:27.450555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:27.717011 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:27.727226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-135fc3a6-0111-43a4-859f-ff5f6e376511 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.301118 Aug 24 14:42:27.728134 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 241/510] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:27 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:27.842483 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:27.843908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:27.851951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:27.853703 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:27.853703 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:27.854607 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:27.855864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:27.856764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:28.118136 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:28.118136 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:28.118362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:28.118362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7011c71c-c173-4b50-822d-4cc24ef5712b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.278439 Aug 24 14:42:28.118362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 270/511] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:27 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:28.768603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:28.770020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:28.791672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:28.792968 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:28.794755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:28.796136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:28.796974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:28.797735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:28.975397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:28.986432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3dd8db82-7f3e-45bd-8c8a-9e9bc54e65a5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.229214 Aug 24 14:42:28.987011 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 242/512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:28 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:29.140708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:29.141719 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:29.151099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:29.151597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:29.152200 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:29.153460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:29.154168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:29.154900 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:29.366571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:29.378166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:29.379760 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:29.381194 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-781a9187-98d9-45e8-b275-ad0e6862ddb0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.244998 Aug 24 14:42:29.381970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 271/513] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:29 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:30.019297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:30.020192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:30.031472 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:30.034951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:30.035662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:30.036577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:30.037455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:30.040113 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:30.225657 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:30.237137 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9ba26e1c-d316-4188-93c0-a3dd369d3c8f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.224921 Aug 24 14:42:30.249169 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 243/514] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:30 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:30.408821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:30.410149 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:30.419153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:30.419804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:30.420326 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:30.421127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:30.421672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:30.422236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:30.447582 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:30.610136 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:30.622774 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:30.625045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:30.626378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-bb5bb957-c4bb-4818-9e6f-8a51d61b1980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.225626 Aug 24 14:42:30.642477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 272/515] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:30 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:31.266848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:31.268600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:31.277471 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.278294 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.279228 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.280763 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.281798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.282621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.480040 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:31.496973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a4194c56-b9c1-44f5-8e6e-a65640700281 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.240108 Aug 24 14:42:31.497813 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 244/516] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:31 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:31.655030 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:31.655689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:31.657661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=83 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:31.662653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.663661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.664481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.665700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:31.666338 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:31.667191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:31.866233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:31.876616 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:31.878352 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:31.879541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-15b34507-0b0a-460a-ba94-da8f94664fdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.230885 Aug 24 14:42:31.880417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 273/517] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:31 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:32.531494 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:32.532472 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:32.538824 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:32.539309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:32.539736 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:32.540435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:32.541206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:32.541633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:32.700843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:32.710624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0113d2e0-c076-401f-81c9-7bd2b8ceec3d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.183684 Aug 24 14:42:32.716614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 245/518] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:32 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:32.907418 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:32.908224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:32.914588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:32.915624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:32.915624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:32.916340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:32.916802 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:32.917231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:33.102257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:33.112008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:33.118257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:33.119975 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-324475e8-45a8-4433-a29a-0024ae12b3b8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.217589 Aug 24 14:42:33.121428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 274/519] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:32 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:33.737384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:33.740027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:33.745325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:33.746434 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:33.747138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:33.747792 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:33.748287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:33.748970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:33.947795 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:33.956856 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-736b2905-1ddc-44ca-a13c-d7e4ede8fbb4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.224638 Aug 24 14:42:33.957505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 246/520] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:33 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:34.158801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:34.159778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:34.166474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:34.166988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:34.168041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:34.169159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:34.169610 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:34.170072 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:34.320199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:34.332779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:34.334368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:34.335541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3f659006-46de-4392-96f3-190e4bcb52fb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.183833 Aug 24 14:42:34.336107 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 275/521] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:34 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:34.979658 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:34.981354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:34.988473 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:34.988972 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:34.989403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:34.990135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:34.991058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:34.991305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:35.149816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:35.158847 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-162086cb-95f1-4e10-bca5-39328f4d2656 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.183178 Aug 24 14:42:35.159423 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 247/522] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:34 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:35.362914 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:35.364337 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:35.371095 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:35.371821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:35.372461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:35.373388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:35.374089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:35.374826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:35.555901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:35.569743 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:35.572970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:35.575667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-96feaa0a-6bf1-41ad-8274-1a1b2705dcf4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.217241 Aug 24 14:42:35.577621 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 276/523] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:35 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:36.181344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:36.183870 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:36.204566 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:36.205403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:36.206047 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:36.207116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:36.207785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:36.214033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:36.562724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:36.576412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0b7c5747-63af-4f7c-82ce-7fa8f0ef4482 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.399494 Aug 24 14:42:36.590917 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 248/524] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:36 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:36.601205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:36.602011 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:36.628513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:36.629551 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:36.634305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:36.635506 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:36.636725 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:36.637388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:37.109321 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:37.120794 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:37.123254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:37.124708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1b6feca8-ff89-4d7a-9c49-da8aa3237dbc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.528240 Aug 24 14:42:37.125836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 277/525] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:36 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:37.600701 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:37.602175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:37.610937 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:37.611763 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:37.612536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:37.613457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:37.613942 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:37.614536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:37.857411 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:37.876528 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ad963af0-8426-4053-bf63-cdf8f0a12cf5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.278979 Aug 24 14:42:37.879443 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 249/526] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:37 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:38.148835 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:38.149620 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:38.164603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:38.165614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:38.166497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:38.169215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:38.172718 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:38.175862 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:38.477848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:38.505937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:38.507558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:38.510646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-41dbc465-8db9-454a-a210-232335ba57b0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.364083 Aug 24 14:42:38.511691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 278/527] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:38 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:38.903998 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:38.905328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:38.917095 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:38.919476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:38.920140 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:38.920891 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:38.921715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:38.922287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:39.085676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:39.101997 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c3c196a2-0bdb-4eeb-b199-0d5b1b45add5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1723 microversion: 2.1 time: 0.203779 Aug 24 14:42:39.109975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 250/528] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:38 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:39.535075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:39.536044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:39.543503 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:39.544207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:39.546460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:39.550467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:39.550467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:39.550467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:39.799091 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:39.825789 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:39.832839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:39.841280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ebf2e206-9eee-4bfa-88ae-fae1174bdea5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.310497 Aug 24 14:42:39.846817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 279/529] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:39 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:40.135225 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:40.136971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:40.145219 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.145715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.146599 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.147498 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.147962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.148397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.326906 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:40.336913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1503092b-0f70-48a2-83c0-5193291bbd16 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1700 microversion: 2.1 time: 0.207825 Aug 24 14:42:40.338339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 251/530] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:40 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1700 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:40.359948 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-03bdd2f3-e9ad-4370-b4f6-d3dcdd4b89f5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:40.368086 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03bdd2f3-e9ad-4370-b4f6-d3dcdd4b89f5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.368687 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03bdd2f3-e9ad-4370-b4f6-d3dcdd4b89f5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.369161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-03bdd2f3-e9ad-4370-b4f6-d3dcdd4b89f5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.447981 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-03bdd2f3-e9ad-4370-b4f6-d3dcdd4b89f5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Going to try to start instance {{(pid=132890) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 14:42:40.698425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-03bdd2f3-e9ad-4370-b4f6-d3dcdd4b89f5 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/action" status: 202 len: 0 microversion: 2.1 time: 0.342679 Aug 24 14:42:40.704081 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 280/531] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:42:40 2022] POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:42:40.708966 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:40.709971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:40.716962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.717814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.718282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.719260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.719750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.720461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.743703 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:40.871675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:40.871675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:40.880417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.888493 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.889370 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.890206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:40.890900 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:40.891536 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:40.926369 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:40.940853 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e26e5480-2680-4f47-9178-296485a90e1c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1709 microversion: 2.1 time: 0.236036 Aug 24 14:42:40.941782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 252/532] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:40 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1709 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:42:41.076678 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:41.087157 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:41.088911 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:41.090202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3481c158-7759-48e3-9f76-e54b3d0af343 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1737 microversion: 2.20 time: 0.224449 Aug 24 14:42:41.091074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 281/533] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:40 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:41.965588 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:41.966297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:41.983372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:41.984020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:41.986395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:41.987153 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:41.987623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:41.988057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:42.116766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:42.118509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:42.137278 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:42.138775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:42.140040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:42.141479 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:42.142829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:42.143936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:42.345786 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:42.375230 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c01d1b53-354e-4fc0-9df9-7fa9139aaaab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1709 microversion: 2.1 time: 0.403855 Aug 24 14:42:42.375230 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 253/534] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:41 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1709 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:42.489788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:42.499808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:42.501687 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:42.503511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d0afa874-ed37-4d68-a76a-c1927b0ff025 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1719 microversion: 2.20 time: 0.391108 Aug 24 14:42:42.521811 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 282/535] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:42 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1719 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:43.402319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:43.403634 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:43.410238 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:43.411014 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:43.411481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:43.412175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:43.412659 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:43.413098 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:43.529838 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:43.530751 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:43.540165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:43.544753 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:43.546012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:43.546012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:43.546484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:43.546909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:43.580365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:43.591152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7a70b8a8-f4af-4474-ac06-416afbe4eabf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1709 microversion: 2.1 time: 0.193199 Aug 24 14:42:43.593491 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 254/536] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:43 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:43.727806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:43.739789 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:43.741523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:43.742776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-46c254fc-8e8d-4c60-b489-346d750e37dc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1719 microversion: 2.20 time: 0.217837 Aug 24 14:42:43.744047 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 283/537] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:43 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:44.551292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-84fd2b10-7845-4b1f-bb7a-ded37fbd673b req-384c9bdc-c1c5-4c76-ae38-d30ef42620a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687c842a-2354-49c5-9c12-165babf4a0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "e937f76f-4ef7-4572-b805-b6918a000637"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:44.562855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:44.565967 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-84fd2b10-7845-4b1f-bb7a-ded37fbd673b req-384c9bdc-c1c5-4c76-ae38-d30ef42620a5 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.566754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-84fd2b10-7845-4b1f-bb7a-ded37fbd673b req-384c9bdc-c1c5-4c76-ae38-d30ef42620a5 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.567393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-84fd2b10-7845-4b1f-bb7a-ded37fbd673b req-384c9bdc-c1c5-4c76-ae38-d30ef42620a5 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.597441 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-84fd2b10-7845-4b1f-bb7a-ded37fbd673b req-384c9bdc-c1c5-4c76-ae38-d30ef42620a5 service nova] Creating event network-vif-unplugged:e937f76f-4ef7-4572-b805-b6918a000637 for instance 687c842a-2354-49c5-9c12-165babf4a0d6 on hv-cinder-75671 Aug 24 14:42:44.607081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-84fd2b10-7845-4b1f-bb7a-ded37fbd673b req-384c9bdc-c1c5-4c76-ae38-d30ef42620a5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057934 Aug 24 14:42:44.612608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:44.615662 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:44.624511 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 255/538] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:42:44.627581 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.628631 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.629376 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.630466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.631142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.631725 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.770732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:44.770732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:44.799158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.799158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.799158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.801063 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:44.801843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:44.802475 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:44.873023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:44.882858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5d03c426-6a40-4927-8711-82626e8e7877 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1713 microversion: 2.1 time: 0.273970 Aug 24 14:42:44.897063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 284/539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:42:44 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1713 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:42:45.026596 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:45.036939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:45.038516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:45.039861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dfadbdf4-27ed-43d9-80f4-c750b6e24216 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1719 microversion: 2.20 time: 0.275389 Aug 24 14:42:45.061026 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 256/540] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:44 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1719 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:42:46.068619 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:46.070381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:46.084228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:46.084723 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:46.085375 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:46.086157 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:46.086784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:46.087403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:46.301645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:46.322573 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:46.330116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:46.335625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-940b6120-1dbf-469c-969d-c5959e688877 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1662 microversion: 2.20 time: 0.270027 Aug 24 14:42:46.336744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 285/541] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:46 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1662 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:46.374794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f3031dc-bed3-4493-9b33-07c7bcbb342e"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:46.377934 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:46.385663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:46.386518 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:46.387949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:46.389800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:46.390586 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:46.391743 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:47.898368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-450a40df-30f3-4159-ae89-e05c2250a9a0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.530228 Aug 24 14:42:47.928018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 257/542] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 24 14:42:46 2022] POST /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 188 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:42:48.081471 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:42:48.082174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:48.090541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:48.091458 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:48.092542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:48.093999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:48.095548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:48.096131 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:48.159465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132890) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 14:42:48.410168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:42:48.552018 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-35bce482-b2ea-42f5-b702-b04e19a2fad1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/action" status: 202 len: 0 microversion: 2.20 time: 0.474733 Aug 24 14:42:48.555387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 286/543] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 24 14:42:48 2022] POST /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:42:48.565275 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:48.565953 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:48.579643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:48.580828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:48.580828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:48.581533 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:48.582009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:48.582438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:48.784340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:48.798440 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:48.799924 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:48.801079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5a8e7bd5-1c11-49c5-84eb-d63d26a82bac tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1748 microversion: 2.20 time: 0.241117 Aug 24 14:42:48.801634 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 258/544] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:48 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1748 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:49.827786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:49.830768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:49.841675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:49.842586 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:49.843003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:49.843705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:49.844327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:49.844756 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:50.067027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:50.080892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:50.082967 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:50.084478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c5c9df7e-ed69-43ae-b2c3-daf1bd88ec00 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1748 microversion: 2.20 time: 0.263697 Aug 24 14:42:50.085780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 287/545] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:49 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1748 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:51.122366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:51.123687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:51.133367 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:51.136529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:51.136529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:51.137798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:51.138593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:51.139980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:51.349651 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:51.362239 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:51.363846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:51.365072 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-252275fa-9ba3-49f6-913f-601f499108f9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1750 microversion: 2.20 time: 0.252063 Aug 24 14:42:51.366193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 259/546] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:51 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1750 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:52.410578 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:52.412927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:52.425801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:52.429215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:52.429215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:52.429215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:52.430598 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:52.431288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:52.722448 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:52.732460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:52.735225 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:52.736756 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4bd53832-9510-4937-ba0b-ad9accd7800d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1750 microversion: 2.20 time: 0.333591 Aug 24 14:42:52.737597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 288/547] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:52 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1750 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:53.763094 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:53.764094 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:53.774218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:53.774969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:53.775640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:53.778824 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:53.779687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:53.780374 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:54.101195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:54.111496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:54.112984 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:54.114316 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d1b87349-b848-4c5f-9de8-18e9ec4e8c1d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.356107 Aug 24 14:42:54.115787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 260/548] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:53 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:55.138132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:55.138777 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:55.145223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:55.145719 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:55.146180 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:55.146888 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:55.147343 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:55.147770 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:55.299222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:55.309800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:55.311389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:55.312722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a12a9658-cf1c-42c1-a096-a0703e807d8d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.178657 Aug 24 14:42:55.313296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 289/549] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:55 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:56.347455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:56.348448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:56.360087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:56.360973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:56.361527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:56.362408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:56.362980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:56.363513 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:56.550412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:56.561405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:56.563359 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:56.564598 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2821ebf8-14ac-4767-953a-80abd4a270a2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.228179 Aug 24 14:42:56.565798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 261/550] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:56 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:57.598118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:57.598854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:57.613263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.614478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.615433 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.616629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:57.617563 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:57.618354 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:57.798273 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:57.811160 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:57.813010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:57.814621 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8214d6a0-aa47-4e5a-a2ee-49770e0c5600 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.224499 Aug 24 14:42:57.815273 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 290/551] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:57 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:42:58.843462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:42:58.844089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:42:58.850864 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:58.851368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:58.851838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:58.852539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:42:58.852988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:42:58.853401 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:42:59.366322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:59.395636 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:59.397270 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:42:59.400424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dca59b8a-3165-4d46-b5c0-30e1d031af95 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.560124 Aug 24 14:42:59.402033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 262/552] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:42:58 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:00.428859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:00.429468 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:00.436378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:00.436869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:00.437487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:00.438043 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:00.438501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:00.438928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:00.626689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:00.642207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:00.643741 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:00.644943 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7971cec5-dbe2-4a43-ba11-abe9f90fe9f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.223042 Aug 24 14:43:00.652602 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 291/553] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:00 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:01.671287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:01.672603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:01.689966 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:01.690735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:01.696591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:01.696591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:01.696591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:01.696591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:01.911895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:01.929770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:01.936755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:01.940389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d26a2049-5d5f-4bb8-a8e1-7d92ffe2c887 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.272702 Aug 24 14:43:01.941698 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 263/554] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:01 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:02.976281 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:02.977900 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:02.984163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:02.985779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:02.986478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:02.987055 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:02.988099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:02.988698 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:02.989167 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:03.209564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:03.221710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:03.224051 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:03.225477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-18645c2c-df18-4379-8aa8-3aaeae16882d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.253124 Aug 24 14:43:03.242419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 292/555] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:02 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:04.253089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:04.254462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:04.280302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:04.280302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:04.280302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:04.280302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:04.280731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:04.280731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:04.653279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:04.662655 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:04.664952 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:04.667874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8bb6f336-77ef-4f01-8da4-5cc12a6013bd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.418992 Aug 24 14:43:04.681332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 264/556] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:04 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:05.720516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:05.722835 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:05.732762 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.733661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.734586 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.736155 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:05.738770 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:05.739966 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:05.934662 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:05.949448 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:05.951484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:05.952961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9fe66bc3-d49d-452f-aca1-a3c5f10569e7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.238671 Aug 24 14:43:05.961362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 293/557] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:05 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:06.983150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:06.984124 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:06.992101 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:06.992747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:06.993221 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:06.993967 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:06.994455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:06.994893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:07.155462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:07.164383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:07.165941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:07.167976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-816f483a-af69-4e33-aa86-ec7d5faec070 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.193964 Aug 24 14:43:07.168537 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 265/558] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:06 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:08.192223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:08.192876 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:08.199499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:08.199988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:08.200424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:08.201133 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:08.201586 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:08.202055 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:08.362405 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:08.372193 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:08.373686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:08.374872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-928a51ee-60f7-42b5-96ba-4cdc2026add4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.186629 Aug 24 14:43:08.375433 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 294/559] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:08 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:08.843702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1111998833", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "networks": [{"uuid": "6e91440f-5ea9-42a5-b494-abdbcfd5be01"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:08.902631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] validate_networks() for [('6e91440f-5ea9-42a5-b494-abdbcfd5be01', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:43:09.334935 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:43:09.335354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:43:09.335829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:43:09.336227 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:43:09.336624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:43:09.345682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:09.346204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:09.346626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:09.347340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:09.347789 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:09.348207 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:09.365829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Getting quotas for project 5ef660ba9b3f42a7aa15458d0a70eb25. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:43:09.370541 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Getting quotas for user 565cb12d581c4cc5939ca955b07ae842 and project 5ef660ba9b3f42a7aa15458d0a70eb25. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:43:09.381921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:43:09.384213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:43:09.398802 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:09.399379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:09.407252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:09.407820 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:09.408366 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:09.415099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:09.415099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:09.415099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:09.566020 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:09.575361 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:09.576881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:09.578090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ede91a9c-97fc-4a7b-8d17-5b01ead659bc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.183718 Aug 24 14:43:09.578651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 295/560] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:09 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:09.643904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-72b3714f-6582-4730-95af-8e93f5c07a8e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804164 Aug 24 14:43:09.644823 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 266/561] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:43:09.661310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-03501b95-7538-43cd-ae76-e96c0b2a8924 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:09.661959 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-03501b95-7538-43cd-ae76-e96c0b2a8924 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:09.748264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-03501b95-7538-43cd-ae76-e96c0b2a8924 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:09.755906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-03501b95-7538-43cd-ae76-e96c0b2a8924 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1219 microversion: 2.1 time: 0.098341 Aug 24 14:43:09.756495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 296/562] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:09 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:10.601503 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:10.602129 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:10.608685 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:10.609176 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:10.609605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:10.610368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:10.610860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:10.611388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:10.776994 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:10.778085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-87b3f112-ae28-4105-b149-443df16680a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:10.779222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-87b3f112-ae28-4105-b149-443df16680a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:10.780668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:10.786672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:10.788884 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:10.789802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-564c3098-482c-40f1-a611-eedca6d8266f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.192718 Aug 24 14:43:10.790365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 267/563] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:10 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:10.846590 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-87b3f112-ae28-4105-b149-443df16680a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:10.854256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-87b3f112-ae28-4105-b149-443df16680a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1219 microversion: 2.1 time: 0.081515 Aug 24 14:43:10.854798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 297/564] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:10 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:11.821719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:11.822935 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:11.830544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.831033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.831492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.832384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.832835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.833258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.886268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:11.899056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:11.907920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.910000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.910000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:11.910000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:11.912240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:11.912240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:12.008326 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:12.022806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-64817912-4ed0-42e9-ad2f-7ee1f87d236a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1223 microversion: 2.1 time: 0.150202 Aug 24 14:43:12.023873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 298/565] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:11 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:12.145463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:12.158458 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:12.159964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:12.161141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a4cbae6b-00cb-4777-bc55-664a320f8a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.344429 Aug 24 14:43:12.161696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 268/566] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:11 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:13.048936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:13.051356 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:13.062207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:13.063009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:13.063941 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:13.065128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:13.065964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:13.066852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:13.186529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:13.191904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:13.193053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:13.199848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2d6a6501-d576-4da2-823a-2ecf9a260a81 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1279 microversion: 2.1 time: 0.155022 Aug 24 14:43:13.212443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 299/567] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:13 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:13.212673 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:13.212673 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:13.212673 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:13.212673 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:13.213329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:13.213329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:13.469925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:13.481291 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:13.482896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:13.484190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bf5a1a28-0a89-4986-83ed-6ecc1fb05ab1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.300840 Aug 24 14:43:13.484791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 269/568] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:13 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:14.223308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:14.223957 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:14.231780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:14.234239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:14.234239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:14.234239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:14.234239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:14.234899 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:14.496286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:14.504442 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-672e132e-e9b2-4c00-ba29-41f6d4c64690 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.285108 Aug 24 14:43:14.505067 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 300/569] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:14 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:14.512927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:14.514233 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:14.522804 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:14.523456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:14.524180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:14.525066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:14.526129 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:14.526773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:14.787480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:14.800639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:14.802262 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:14.803631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-46564749-653a-4088-b11d-f7d2a23cec5a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.298696 Aug 24 14:43:14.804220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 270/570] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:14 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:15.230024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-5faff312-3f99-4fae-bc80-3d20f9ce6914 req-91e96a4a-c187-478e-99f0-d35ebb8e9cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29930367-1d53-439a-84a3-a4896944eabb", "tag": "02679640-6964-41ab-8e8f-6ec854f0615b"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:15.242125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5faff312-3f99-4fae-bc80-3d20f9ce6914 req-91e96a4a-c187-478e-99f0-d35ebb8e9cca service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:15.242804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5faff312-3f99-4fae-bc80-3d20f9ce6914 req-91e96a4a-c187-478e-99f0-d35ebb8e9cca service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:15.243764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5faff312-3f99-4fae-bc80-3d20f9ce6914 req-91e96a4a-c187-478e-99f0-d35ebb8e9cca service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:15.282904 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-5faff312-3f99-4fae-bc80-3d20f9ce6914 req-91e96a4a-c187-478e-99f0-d35ebb8e9cca service nova] Creating event network-changed:02679640-6964-41ab-8e8f-6ec854f0615b for instance 29930367-1d53-439a-84a3-a4896944eabb on hv-cinder-75671 Aug 24 14:43:15.290197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-5faff312-3f99-4fae-bc80-3d20f9ce6914 req-91e96a4a-c187-478e-99f0-d35ebb8e9cca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064726 Aug 24 14:43:15.290750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 301/571] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:15.532218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:15.532914 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:15.535314 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:15.545568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:15.545568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:15.545568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:15.545568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:15.545986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:15.545986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:15.763255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:15.771440 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f16aea5c-d196-42e4-8208-f18fa9cbe8c1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.243024 Aug 24 14:43:15.773816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 271/572] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:15 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:15.828008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:15.828641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:15.835514 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:15.836018 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:15.836454 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:15.837153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:15.837600 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:15.838093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:16.104934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:16.115217 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:16.116738 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:16.117970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-fa9d92c2-c733-4323-8481-82fc4a6df933 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.295071 Aug 24 14:43:16.118544 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 302/573] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:15 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:16.793390 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:16.794015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:16.800717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:16.801192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:16.801616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:16.802756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:16.802883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:16.803270 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:16.942247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:16.950787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-51f0e8f4-bc30-4a59-a2e2-ea5a6b90c1be tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.162086 Aug 24 14:43:16.951293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 272/574] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:16 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:17.142642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:17.143245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:17.149514 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.150035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.151085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:17.151965 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.152421 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.153019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:17.334019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:17.344435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:17.345979 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:17.347134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0027881e-6cb0-4223-b0a2-420d2ccd55ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.208354 Aug 24 14:43:17.347699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 303/575] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:17 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:17.972937 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:17.973488 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:17.980833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.981303 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.981731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:17.982449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:17.982890 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:17.983306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:18.134922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:18.142727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-56fd2420-3df4-422a-a25b-2b060d6f08da tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.173865 Aug 24 14:43:18.143288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 273/576] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:17 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:18.372403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:18.373007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:18.379295 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:18.379780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:18.380212 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:18.380931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:18.381366 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:18.381818 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:18.530045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:18.543045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:18.545694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:18.547510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dc3a5ff9-2d94-414c-8063-2abd295dbd23 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.180845 Aug 24 14:43:18.548505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 304/577] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:18 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:19.164479 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:19.165173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:19.172548 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:19.173019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:19.173454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:19.174188 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:19.174663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:19.175087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:19.321399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:19.329893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-144722fc-cf0d-41d6-90e8-303a5f90e504 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.169198 Aug 24 14:43:19.330492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 274/578] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:19 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:19.573591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:19.574223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:19.580551 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:19.581041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:19.581475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:19.582218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:19.582670 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:19.583088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:19.742231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:19.752266 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:19.753784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:19.754963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-75dabeaa-7936-4cc6-b281-e2c8adf3981c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.186058 Aug 24 14:43:19.755516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 305/579] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:19 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:20.352696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:20.354326 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:20.356505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:20.359073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:20.364635 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:20.365115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:20.365536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:20.366304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:20.366816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:20.367368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:20.518962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:20.532020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ca918a18-c89a-4ccd-9454-2eb623403414 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.182737 Aug 24 14:43:20.532950 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 275/580] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:20 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:20.779613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:20.780173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:20.786175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:20.786651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:20.787080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:20.787775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:20.788394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:20.788819 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:20.792346 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=99 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:20.850929 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=4 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:20.951491 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:20.960414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:20.961927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:20.963192 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-bc06e8cb-b17c-4540-8879-168ec0f6cca9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.187521 Aug 24 14:43:20.963917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 306/581] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:20 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:21.561160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:21.561892 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:21.568834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:21.569321 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:21.569785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:21.570470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:21.570926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:21.571346 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:21.740350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:21.749243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-87f6acfa-3398-4042-99ef-915ff996262a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.192128 Aug 24 14:43:21.754964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 276/582] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:21 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:21.988013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:21.988566 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:21.995873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:21.996428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:21.997052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:21.997784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:21.998315 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:21.998902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.165455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:22.182256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:22.184864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:22.186724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-349cec18-1f50-44ae-b630-ff2beb4e1f68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.202905 Aug 24 14:43:22.187536 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 307/583] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:21 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:22.776572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:22.777566 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:22.786632 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:22.787496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:22.788273 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.789530 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:22.790397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:22.791808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:22.997447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:23.021033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dfe6e60f-52c7-4515-ad3c-d421e24d1124 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.251799 Aug 24 14:43:23.022002 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 277/584] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:22 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:23.135188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-5aba7b62-7b0e-4e64-a09c-bee2f45c13ba req-7ab1a25d-52dc-437b-91bd-ea74f247f8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29930367-1d53-439a-84a3-a4896944eabb", "name": "network-vif-plugged", "status": "completed", "tag": "02679640-6964-41ab-8e8f-6ec854f0615b"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:23.145975 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5aba7b62-7b0e-4e64-a09c-bee2f45c13ba req-7ab1a25d-52dc-437b-91bd-ea74f247f8e6 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:23.146459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5aba7b62-7b0e-4e64-a09c-bee2f45c13ba req-7ab1a25d-52dc-437b-91bd-ea74f247f8e6 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:23.146885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5aba7b62-7b0e-4e64-a09c-bee2f45c13ba req-7ab1a25d-52dc-437b-91bd-ea74f247f8e6 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:23.160222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-5aba7b62-7b0e-4e64-a09c-bee2f45c13ba req-7ab1a25d-52dc-437b-91bd-ea74f247f8e6 service nova] Creating event network-vif-plugged:02679640-6964-41ab-8e8f-6ec854f0615b for instance 29930367-1d53-439a-84a3-a4896944eabb on hv-cinder-75671 Aug 24 14:43:23.166583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-5aba7b62-7b0e-4e64-a09c-bee2f45c13ba req-7ab1a25d-52dc-437b-91bd-ea74f247f8e6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037045 Aug 24 14:43:23.167267 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 308/585] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:23.218446 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:23.219097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:23.227058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:23.227545 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:23.228030 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:23.229730 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:23.230794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:23.231543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:23.433351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:23.447796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:23.450233 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:23.452428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-adac85d2-2d6f-47c4-b2d6-d11b6b151c6c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.237757 Aug 24 14:43:23.453282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 278/586] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:23 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:24.051006 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:24.052044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:24.061693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:24.062215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:24.062652 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:24.063362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:24.063805 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:24.064224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:24.231753 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:24.240138 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d1b8cc53-363c-4f85-a27f-5803f434b387 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.193521 Aug 24 14:43:24.240730 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 309/587] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:24 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:24.478510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:24.479226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:24.486974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:24.487461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:24.487936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:24.489013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:24.489543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:24.490092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:24.649569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:24.662470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:24.664031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:24.665197 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a3510633-df8f-4b67-8aa1-1a819fa41e4c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.191430 Aug 24 14:43:24.665808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 279/588] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:24 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:25.266456 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:25.267113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:25.279277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.279782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.280474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.281191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.281647 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.282093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.309105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-000b11b0-5ba8-403b-9339-8b1d2cde48ce req-7c51abdd-a3f0-49bb-938e-3b3c9ebe6d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687c842a-2354-49c5-9c12-165babf4a0d6", "name": "network-vif-plugged", "status": "completed", "tag": "e937f76f-4ef7-4572-b805-b6918a000637"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:25.318808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-000b11b0-5ba8-403b-9339-8b1d2cde48ce req-7c51abdd-a3f0-49bb-938e-3b3c9ebe6d16 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.319284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-000b11b0-5ba8-403b-9339-8b1d2cde48ce req-7c51abdd-a3f0-49bb-938e-3b3c9ebe6d16 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.319700 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-000b11b0-5ba8-403b-9339-8b1d2cde48ce req-7c51abdd-a3f0-49bb-938e-3b3c9ebe6d16 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.331631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-000b11b0-5ba8-403b-9339-8b1d2cde48ce req-7c51abdd-a3f0-49bb-938e-3b3c9ebe6d16 service nova] Creating event network-vif-plugged:e937f76f-4ef7-4572-b805-b6918a000637 for instance 687c842a-2354-49c5-9c12-165babf4a0d6 on hv-cinder-75671 Aug 24 14:43:25.336994 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-000b11b0-5ba8-403b-9339-8b1d2cde48ce req-7c51abdd-a3f0-49bb-938e-3b3c9ebe6d16 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032472 Aug 24 14:43:25.338138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 280/589] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:43:25.453546 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:25.463442 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4aefdf57-8e61-4113-9b01-5bd84c86520f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1319 microversion: 2.1 time: 0.202196 Aug 24 14:43:25.464061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 310/590] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:25 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:25.694307 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:25.694910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:25.701535 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.702084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.702524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.703234 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:25.703683 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:25.704105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:25.871239 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:25.887907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:25.890913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:25.893108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ec706f85-5cdb-492f-b1fe-de708d6a768a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.203588 Aug 24 14:43:25.894147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 281/591] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:25 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:26.488833 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:26.489920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:26.500796 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:26.501307 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:26.501947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:26.502748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:26.503200 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:26.503624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:26.717344 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:26.733093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c7688396-9736-4abd-825a-c1ffc243ebbd tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1509 microversion: 2.1 time: 0.250337 Aug 24 14:43:26.734753 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 311/592] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:26 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:26.920675 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:26.921457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:26.933596 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:26.934497 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:26.935253 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:26.936498 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:26.937479 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:26.938353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:27.119371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:27.135592 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:27.138661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:27.145342 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6c35a6c4-9756-4fdd-ac75-0599ebead729 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.225357 Aug 24 14:43:27.145342 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 282/593] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:26 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:43:28.171363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:28.172146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:28.182055 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:28.183311 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:28.183624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:28.186955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:28.186955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:28.186955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:28.365497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:28.374737 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:28.376227 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:28.377393 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-df60c83b-3d71-4b20-8c98-a6e35f48db52 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.212669 Aug 24 14:43:28.377972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 312/594] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:28 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:29.418338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:29.419226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:29.425862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:29.426383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:29.426814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:29.427750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:29.428199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:29.429435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:29.608652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:29.621013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:29.624028 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:29.626625 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d03eb77e-33c6-4ec0-9c25-391a5596f15a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.213561 Aug 24 14:43:29.627672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 283/595] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:29 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:30.669897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:30.670612 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:30.676851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:30.677337 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:30.677798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:30.678512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:30.678963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:30.679388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:30.874689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:30.884761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:30.886466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:30.888414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-eeac3d1b-e3eb-4b06-8c39-2025d0481a5b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1806 microversion: 2.20 time: 0.222957 Aug 24 14:43:30.889568 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 313/596] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:30 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1806 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:31.919962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:31.920740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:31.928546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:31.929382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:31.930163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:31.931412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:31.933093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:31.933865 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:32.350024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:32.361315 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:32.362917 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:32.364161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-42ebfc17-0c2c-4451-83b8-514b8db8ecde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1793 microversion: 2.20 time: 0.449839 Aug 24 14:43:32.365047 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 284/597] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:43:31 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1793 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:43:35.456304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df2b1835-c052-488e-8f8e-50de55c0f191"}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:35.459284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:35.461559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=48 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:35.467506 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:35.468003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:35.468495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:35.469388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:35.469866 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:35.470293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:36.380414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2624bcac-ed1c-47ef-aba9-a3bd8d6ae0c7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.143298 Aug 24 14:43:36.380952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 314/598] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:43:35 2022] POST /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:43:45.047123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:45.049460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:45.051968 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=27 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:45.052644 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=98 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:45.058700 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:45.059252 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:45.059801 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:45.060614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:45.061201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:45.061949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:45.088681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lazy-loading 'flavor' on Instance uuid 3d040cfc-ac45-4941-b04f-a8ba0f061929 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:43:45.638016 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a281509f-5588-4cdf-909a-ea537fdf79c9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/action" status: 200 len: 32 microversion: 2.1 time: 0.594479 Aug 24 14:43:45.638643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 285/599] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:43:45 2022] POST /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/action => generated 32 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:43:45.649112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:45.654870 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:45.655589 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:45.669497 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:45.670088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:45.670559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:45.671305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:45.671805 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:45.672238 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:45.881661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:45.891034 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b6c59ddc-44a9-470d-a41a-19dccd13f127 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.244073 Aug 24 14:43:45.891597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 315/600] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:45 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:46.923645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:46.924511 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:46.931441 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:46.931931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:46.932364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:46.933100 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:46.933552 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:46.934006 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:47.092457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:47.101589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-04d13a3f-6906-4174-8252-82be2dba392f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.182219 Aug 24 14:43:47.102255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 286/601] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:46 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:48.125227 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:48.126082 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:48.135960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:48.136808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:48.137696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:48.138627 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:48.139531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:48.140296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:48.312601 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:48.321937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2fbb73b5-d0b0-4a48-8ea1-199607f92c11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.201262 Aug 24 14:43:48.322614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 316/602] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:48 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:49.343850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:49.344489 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:49.351653 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:49.352144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:49.353568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:49.354368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:49.354818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:49.355510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:49.504425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:49.513044 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-42c5b7fa-2483-410e-b519-aa362c237caf tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.173109 Aug 24 14:43:49.513627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 287/603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:49 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:50.538627 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:50.539817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:50.551230 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:50.552016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:50.552779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:50.553955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:50.554743 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:50.555474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:50.715537 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:50.731426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-17cdab0e-e117-4dcd-a3e4-35f422c2cc72 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.199091 Aug 24 14:43:50.732412 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 317/604] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:50 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:51.754847 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:51.755476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:51.764861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:51.765385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:51.765841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:51.766547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:51.766992 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:51.767408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:51.953377 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:51.962906 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-19c22696-b5f0-4d3c-8067-d1fa2baed82d tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.212019 Aug 24 14:43:51.963639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 288/605] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:51 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:52.992436 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:52.993719 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:53.000650 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:53.001134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:53.001566 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:53.002297 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:53.002747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:53.003160 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:53.006042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:43:53.156096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:53.167272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-27c77f1e-989a-4418-972a-fc8d7dba77ea tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.178838 Aug 24 14:43:53.168287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 318/606] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:52 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:53.309364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67c80675-14d1-4c9c-9525-a01dc25a973d", "device": "/dev/sdb"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:43:53.312323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:53.323460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:53.324038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:53.324522 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:53.325347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:53.325992 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:53.326538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:54.190232 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:54.190840 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:54.198800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:54.199292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:54.199748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:54.200499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:54.201342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:54.201783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:54.267320 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a890554-a769-4438-a69d-001dc9d649d8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "POST /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.962057 Aug 24 14:43:54.269551 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 289/607] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:43:53 2022] POST /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:43:54.373859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:54.384421 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5d70fa67-82bb-4d5f-91eb-3463251b01e2 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.197407 Aug 24 14:43:54.385002 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 319/608] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:54 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:55.407576 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:55.408803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:55.429127 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:55.430008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:55.430857 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:55.432151 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:55.433116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:55.433791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:55.606265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:55.615031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-935312ff-9877-4bef-a088-9e57c4f9f692 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.212525 Aug 24 14:43:55.615619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 290/609] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:55 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:43:56.642412 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:56.643465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:56.650861 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:56.651356 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:56.651826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:56.652699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:56.653158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:56.653589 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:56.826161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:56.838858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9e952437-2bba-4633-b15f-dc223e9ffb64 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.203341 Aug 24 14:43:56.839919 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 320/610] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:56 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:57.869443 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:57.870643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:57.878832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:57.879352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:57.879797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:57.880508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:57.881007 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:57.881580 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:58.070098 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:58.090338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c5281e65-e0a2-4cfe-9fed-76bfc95747c0 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.227346 Aug 24 14:43:58.091380 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 291/611] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:57 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:43:59.123407 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:43:59.124627 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:43:59.136910 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:59.137683 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:59.138378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:59.139485 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:43:59.140199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:43:59.140869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:43:59.369286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:43:59.382897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-6da1ba50-d6a3-4b5d-8305-9aefec06b792 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.266119 Aug 24 14:43:59.383896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 321/612] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:43:59 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:00.410038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:00.410865 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:00.419512 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:00.420361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:00.421106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:00.422350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:00.422808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:00.423232 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:00.603750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:00.613652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b1d13fff-9c16-4468-93cb-ab0aaae9c826 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.207729 Aug 24 14:44:00.614277 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 292/613] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:00 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:01.638965 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:01.639828 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:01.648027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:01.648551 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:01.649506 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:01.650599 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:01.651099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:01.651508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:01.838925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:01.849454 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f360b50f-c352-46e8-862a-2d0b798004b1 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1737 microversion: 2.1 time: 0.214911 Aug 24 14:44:01.850187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 322/614] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:01 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:02.874306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:02.875066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:02.882379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:02.882857 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.883286 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:02.884417 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:02.884952 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:02.885379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.042933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:03.052581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a327eb60-0ae8-460d-8cc1-8299f993a4e7 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1717 microversion: 2.1 time: 0.182291 Aug 24 14:44:03.053170 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 293/615] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:02 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1717 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:03.124882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:03.125762 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:03.139230 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.139734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.140165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.140886 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.141341 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.141797 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.285868 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] HTTP exception thrown: Cannot 'detach_volume' instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 while it is in vm_state rescued Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Request method failure captured: Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments/df2b1835-c052-488e-8f8e-50de55c0f191 HTTP/1.1 Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfTXgYsH_uCUJfw_RHTrVcfWZuvwl5MfL-ONV6ToM9lQxasvAVFAUkas_FvCvirtSAMuI4yIaYvO6wTcH9WvNJRfjugkcJ_JVI0X7snK4GuvM98h5M9_NaBJlX9UxIu4fYv1LxbWGv7hOPUKZuo5xm-IJXTi6uKEbvP_mkItHtXoFc Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:44:03.287501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}] Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 3acc0010e3f54283934b75f58bb6ec93 Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:44:03.291031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Cannot 'detach_volume' instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 while it is in vm_state rescued Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'server_id': '3d040cfc-ac45-4941-b04f-a8ba0f061929', 'id': 'df2b1835-c052-488e-8f8e-50de55c0f191'} Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:44:03.291850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 while it is in vm_state rescued Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 while it is in vm_state rescued Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:44:03.293465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Returning 409 to user: Cannot 'detach_volume' instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 while it is in vm_state rescued {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:44:03.294528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cbaf0ff7-8549-4614-8884-5359aca4dbfd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments/df2b1835-c052-488e-8f8e-50de55c0f191" status: 409 len: 152 microversion: 2.1 time: 0.171648 Aug 24 14:44:03.294528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 323/616] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:44:03 2022] DELETE /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments/df2b1835-c052-488e-8f8e-50de55c0f191 => generated 152 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 14:44:03.302626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:03.303174 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:03.310902 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.311388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.311831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.312540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.312994 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.313419 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.740003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-99cc3293-91a1-4882-8109-afc9bab525ce tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "POST /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/action" status: 202 len: 0 microversion: 2.1 time: 0.441185 Aug 24 14:44:03.741035 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 294/617] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:44:03 2022] POST /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:44:03.752422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:03.753052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:03.761188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.761769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.762215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.762931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:03.763391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:03.763821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:03.976839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:03.996415 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-01f87378-5124-4701-a6df-19adf5acb11c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1725 microversion: 2.1 time: 0.243590 Aug 24 14:44:03.996415 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 324/618] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:03 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:05.027821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:05.028527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:05.035898 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:05.036423 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:05.036879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:05.037608 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:05.038088 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:05.038507 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:05.189492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:05.199266 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0ad5fe0c-8b53-4cda-93bd-2d4eadd1ad8b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1725 microversion: 2.1 time: 0.176374 Aug 24 14:44:05.199858 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 295/619] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:05 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:06.222672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:06.223370 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:06.230610 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:06.231152 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:06.231623 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:06.232784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:06.233454 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:06.234003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:06.391676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:06.400878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2d59c8db-f658-4622-857b-2d56245053bd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1725 microversion: 2.1 time: 0.182246 Aug 24 14:44:06.401459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 325/620] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:06 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:07.426745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:07.427798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:07.440999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:07.441887 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:07.442630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:07.443982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:07.444752 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:07.445483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:07.626278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:07.635595 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5be4a1e7-4172-4e8b-8591-f916fe3adc3c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1725 microversion: 2.1 time: 0.216019 Aug 24 14:44:07.636231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 296/621] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:07 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:08.661133 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:08.662148 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:08.671284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:08.671798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:08.672244 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:08.672972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:08.673427 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:08.673883 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:08.836627 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:08.850605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3931d5b9-6af6-4790-abe4-57945f038155 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1725 microversion: 2.1 time: 0.195555 Aug 24 14:44:08.851551 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 326/622] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:08 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:09.890311 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:09.891088 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:09.897664 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:09.898188 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:09.898619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:09.899983 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:09.900486 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:09.900868 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:09.905704 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:10.049583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:10.058947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bbaee4a3-36c3-4536-9b2c-160d37aeafc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1725 microversion: 2.1 time: 0.173136 Aug 24 14:44:10.059521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 297/623] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:09 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:11.083580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:11.084198 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:11.091362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:11.091827 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:11.092265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:11.093036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:11.093528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:11.093992 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:11.253742 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:11.263383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-6e2342a5-aa2b-4eaa-9b98-1e3acd845418 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1725 microversion: 2.1 time: 0.185234 Aug 24 14:44:11.264410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 327/624] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:11 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:12.288664 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:12.290048 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:12.296946 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.297426 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.297883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.298585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.299036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.299459 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.458610 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:12.467866 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dc96e8c5-623a-4a87-9238-098ac1c1d43e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1731 microversion: 2.1 time: 0.183049 Aug 24 14:44:12.468427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 298/625] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:12 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:12.491953 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:12.492769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:12.500903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.501389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.501846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.502541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:12.502992 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:12.503414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:12.591701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3df216b1-6c94-408c-bb6d-f033d65e6dc4 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103346 Aug 24 14:44:12.592782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 328/626] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 14:44:12 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:13.799247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-c1fc1262-01e8-464c-90ad-4dea7538ef12 req-d4e2e9b6-ba82-46c4-9da7-b570c46a59d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d040cfc-ac45-4941-b04f-a8ba0f061929", "tag": "8789513b-ca10-4941-a025-8a463c9cf8d1"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:13.810001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c1fc1262-01e8-464c-90ad-4dea7538ef12 req-d4e2e9b6-ba82-46c4-9da7-b570c46a59d7 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:13.810481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c1fc1262-01e8-464c-90ad-4dea7538ef12 req-d4e2e9b6-ba82-46c4-9da7-b570c46a59d7 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:13.811032 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c1fc1262-01e8-464c-90ad-4dea7538ef12 req-d4e2e9b6-ba82-46c4-9da7-b570c46a59d7 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:13.824541 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-c1fc1262-01e8-464c-90ad-4dea7538ef12 req-d4e2e9b6-ba82-46c4-9da7-b570c46a59d7 service nova] Creating event network-changed:8789513b-ca10-4941-a025-8a463c9cf8d1 for instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 on hv-cinder-75671 Aug 24 14:44:13.830210 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-c1fc1262-01e8-464c-90ad-4dea7538ef12 req-d4e2e9b6-ba82-46c4-9da7-b570c46a59d7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110751 Aug 24 14:44:13.830821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 299/627] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:15.845523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-55ecd4c9-c5dc-4693-ac9f-ce6dff31fdbf req-4ee8243a-c847-4f77-828a-1c01f7a8a9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d040cfc-ac45-4941-b04f-a8ba0f061929", "tag": "8789513b-ca10-4941-a025-8a463c9cf8d1"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:15.850282 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=29 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:15.868249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-55ecd4c9-c5dc-4693-ac9f-ce6dff31fdbf req-4ee8243a-c847-4f77-828a-1c01f7a8a9c6 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:15.868249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-55ecd4c9-c5dc-4693-ac9f-ce6dff31fdbf req-4ee8243a-c847-4f77-828a-1c01f7a8a9c6 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:15.868249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-55ecd4c9-c5dc-4693-ac9f-ce6dff31fdbf req-4ee8243a-c847-4f77-828a-1c01f7a8a9c6 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:15.870338 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-55ecd4c9-c5dc-4693-ac9f-ce6dff31fdbf req-4ee8243a-c847-4f77-828a-1c01f7a8a9c6 service nova] Creating event network-changed:8789513b-ca10-4941-a025-8a463c9cf8d1 for instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 on hv-cinder-75671 Aug 24 14:44:15.875435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-55ecd4c9-c5dc-4693-ac9f-ce6dff31fdbf req-4ee8243a-c847-4f77-828a-1c01f7a8a9c6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034003 Aug 24 14:44:15.876010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 329/628] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:16.779379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:16.779973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:16.782653 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=31 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:16.788429 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.788908 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.789374 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.790498 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:16.790954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:16.791367 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:16.923753 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lazy-loading 'services' on Instance uuid 5aef7e3a-316c-4347-ae40-5370582a017b {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:44:17.332481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c71bca6-2682-4b6a-97d6-e6102ab4742f tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/os-volume_attachments/c2991c5a-6054-46d9-a124-b253a17db473" status: 202 len: 0 microversion: 2.1 time: 0.678165 Aug 24 14:44:17.334635 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 300/629] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:44:16 2022] DELETE /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/os-volume_attachments/c2991c5a-6054-46d9-a124-b253a17db473 => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:44:24.877546 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-aeb3873b-8ca5-4bb5-8bd4-d645dfe771b8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:24.884823 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeb3873b-8ca5-4bb5-8bd4-d645dfe771b8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:24.885305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeb3873b-8ca5-4bb5-8bd4-d645dfe771b8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:24.885735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeb3873b-8ca5-4bb5-8bd4-d645dfe771b8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:24.888256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=66 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:24.910017 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-aeb3873b-8ca5-4bb5-8bd4-d645dfe771b8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Going to try to stop instance {{(pid=132890) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 14:44:25.139141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-aeb3873b-8ca5-4bb5-8bd4-d645dfe771b8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/action" status: 202 len: 0 microversion: 2.1 time: 0.266682 Aug 24 14:44:25.139769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 330/630] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:44:24 2022] POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:44:25.150001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:25.150716 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:25.157203 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:25.157707 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:25.158161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:25.158860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:25.159313 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:25.159738 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:25.302601 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:25.310913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-87afbe88-8719-4b04-b451-fd6a404b08e8 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.166565 Aug 24 14:44:25.311521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 301/631] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:25 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:26.333849 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:26.334546 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:26.340935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:26.341591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:26.341893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:26.342698 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:26.343153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:26.343653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:26.482259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:26.490264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-771def36-eac2-4845-b341-0fb2b4632698 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.161128 Aug 24 14:44:26.490865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 331/632] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:26 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:27.512993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:27.513644 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:27.520357 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:27.520834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:27.521265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:27.522024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:27.522659 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:27.524489 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:27.685871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:27.694791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-641ccad3-cd95-4cbc-a426-be24338c0995 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.185722 Aug 24 14:44:27.695910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 302/633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:27 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:28.310009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:28.310561 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:28.317191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.317666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.318127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.318810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.319255 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.319673 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.426613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lazy-loading 'services' on Instance uuid 29930367-1d53-439a-84a3-a4896944eabb {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:44:28.718010 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:28.718623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:28.725204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.725681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.726145 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.727136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:28.727690 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:28.728141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:28.735171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7fff1a9e-3035-4262-a21b-061a9fa13572 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "DELETE /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb/os-volume_attachments/67c80675-14d1-4c9c-9525-a01dc25a973d" status: 202 len: 0 microversion: 2.1 time: 0.428833 Aug 24 14:44:28.735808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 332/634] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:44:28 2022] DELETE /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb/os-volume_attachments/67c80675-14d1-4c9c-9525-a01dc25a973d => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:44:28.883292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:28.896049 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac103605-5b0d-4725-81ca-d3b46b4fa993 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.181746 Aug 24 14:44:28.896626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 303/635] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:28 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:29.919918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:29.920603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:29.927420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:29.927681 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:29.928187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:29.928829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:29.929264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:29.930444 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:30.090625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:30.098834 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-06ce9af6-cc0a-4976-afbc-683ee6984c67 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.183550 Aug 24 14:44:30.099417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 333/636] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:29 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:30.930597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:30.931250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:30.938527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:30.939023 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:30.939453 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:30.940162 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:30.940609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:30.941037 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:30.970554 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:44:31.123034 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:31.123669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:31.131034 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:31.131537 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:31.131971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.133538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:31.134107 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:31.134523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.292898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:31.305373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-38defacb-97ae-4232-9a7d-33c1e1efd863 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.186159 Aug 24 14:44:31.305996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 334/637] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:31 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:31.362480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-37305c52-4952-4a59-a710-9134ccc336d3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "DELETE /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 204 len: 0 microversion: 2.1 time: 0.435897 Aug 24 14:44:31.363102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 304/638] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:44:30 2022] DELETE /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:44:31.372823 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:31.373493 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:31.379587 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:31.380071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:31.380500 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.381197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:31.381641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:31.382093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:31.522953 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:31.532065 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-250ea3fb-161a-4eec-b646-85bd59f4076b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1515 microversion: 2.1 time: 0.163137 Aug 24 14:44:31.543146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 335/639] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:31 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:32.328640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:32.329321 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:32.336561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:32.337405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:32.337999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:32.339258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:32.339258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:32.339589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:32.486191 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:32.494878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3183bff5-b2db-4d4a-a7f8-87c4887a4322 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.170398 Aug 24 14:44:32.495477 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 305/640] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:32 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:32.555316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:32.556026 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:32.562493 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:32.563090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:32.563441 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:32.564157 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:32.564589 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:32.565154 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:32.725696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:32.735426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b372b31c-e37c-4b1b-a61b-2bb6303d698c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1515 microversion: 2.1 time: 0.184469 Aug 24 14:44:32.736011 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 336/641] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:32 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:33.516057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:33.516874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:33.523642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:33.524170 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:33.525156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:33.525912 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:33.526376 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:33.526794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:33.694823 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:33.708408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d6a90438-ff1c-4095-b15c-5c2ef5601e01 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.195921 Aug 24 14:44:33.709437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 306/642] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:33 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:33.757177 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:33.758389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:33.765118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:33.765600 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:33.766047 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:33.766744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:33.767253 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:33.767611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:34.011850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:34.019714 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dbf6b00e-0047-4384-bc71-6f027fd2eed8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1515 microversion: 2.1 time: 0.266179 Aug 24 14:44:34.020239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 337/643] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:33 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:44:34.600896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-c0ff1e31-0a61-4df7-809a-88c2935fd638 req-c0cbc3a5-eb19-47c1-bc9b-2af54c849e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29930367-1d53-439a-84a3-a4896944eabb", "name": "network-vif-deleted", "tag": "02679640-6964-41ab-8e8f-6ec854f0615b"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:34.611140 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c0ff1e31-0a61-4df7-809a-88c2935fd638 req-c0cbc3a5-eb19-47c1-bc9b-2af54c849e81 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:34.620217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c0ff1e31-0a61-4df7-809a-88c2935fd638 req-c0cbc3a5-eb19-47c1-bc9b-2af54c849e81 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:34.620217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c0ff1e31-0a61-4df7-809a-88c2935fd638 req-c0cbc3a5-eb19-47c1-bc9b-2af54c849e81 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:34.623043 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-c0ff1e31-0a61-4df7-809a-88c2935fd638 req-c0cbc3a5-eb19-47c1-bc9b-2af54c849e81 service nova] Creating event network-vif-deleted:02679640-6964-41ab-8e8f-6ec854f0615b for instance 29930367-1d53-439a-84a3-a4896944eabb on hv-cinder-75671 Aug 24 14:44:34.627971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-c0ff1e31-0a61-4df7-809a-88c2935fd638 req-c0cbc3a5-eb19-47c1-bc9b-2af54c849e81 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031821 Aug 24 14:44:34.628549 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 307/644] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:44:34.732073 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:34.732722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:34.739174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:34.740593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:34.740593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:34.740799 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:34.741244 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:34.741678 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:34.891895 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:34.901632 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-501f4fcf-6e53-4f77-a770-dc84e6944af3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.173869 Aug 24 14:44:34.902368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 338/645] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:34 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:35.044389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:35.045275 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:35.052519 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:35.053018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:35.053474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:35.054200 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:35.054697 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:35.055648 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:35.126637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:35.135158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4178f65a-13b9-4f24-b1a6-36d9938e53f6 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1304 microversion: 2.1 time: 0.096161 Aug 24 14:44:35.135793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 308/646] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:35 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:35.923506 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:35.924127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:35.930983 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:35.931665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:35.932265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:35.933064 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:35.933517 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:35.933971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.079932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:36.094493 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1629c937-548f-4e1e-a637-92b366dbe3dd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.174886 Aug 24 14:44:36.102822 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 339/647] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:35 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:36.157356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:36.159911 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:36.165037 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.165524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.166044 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.166731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.167173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.167584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.201983 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:36.202462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:36.202882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:36.203322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lazy-loading 'fault' on Instance uuid 29930367-1d53-439a-84a3-a4896944eabb {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:44:36.264349 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:36.275299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ce61c9f4-60e6-4703-baa1-8ab7976f1111 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 200 len: 1309 microversion: 2.1 time: 0.122312 Aug 24 14:44:36.276232 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 309/648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:36 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:37.116586 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:37.118061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:37.124960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:37.125444 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:37.125976 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:37.126898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:37.127350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:37.127775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:37.274611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:37.284654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-89dd9d10-c6ad-455e-b65e-23732b619ddf tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.171789 Aug 24 14:44:37.285265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 340/649] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:37 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:37.312050 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:37.312708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 29930367-1d53-439a-84a3-a4896944eabb] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:37.319516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:37.320626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:37.321427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:37.322284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:37.322769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:37.323237 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:37.338569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] HTTP exception thrown: Instance 29930367-1d53-439a-84a3-a4896944eabb could not be found. Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Request method failure captured: Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb HTTP/1.1 Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjj5cInX8esdMwUrQGVNwcctpKWgC_-4HEIzQhWxv5CmD765QVT_5p3FIEz-pe2PyJAKcczqnJnu4hlRJvhlD54bLSw1S-6ijvwkNTKph91BqJsZin-2NJzxzkUWNsl1d2wBGTE0MgSzA4htGJMTPa9v2Oezrb7H_B4_SoYTlnAAn94 Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 5ef660ba9b3f42a7aa15458d0a70eb25 Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesSnapshotTestJSON-884119791 Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:44:37.340224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5ef660ba9b3f42a7aa15458d0a70eb25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5ef660ba9b3f42a7aa15458d0a70eb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5ef660ba9b3f42a7aa15458d0a70eb25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5ef660ba9b3f42a7aa15458d0a70eb25"}]}] Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesSnapshotTestJSON-884119791 Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 5ef660ba9b3f42a7aa15458d0a70eb25 Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-884119791 Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesSnapshotTestJSON-884119791-project Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 565cb12d581c4cc5939ca955b07ae842 Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesSnapshotTestJSON-884119791-project Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 29930367-1d53-439a-84a3-a4896944eabb could not be found. Aug 24 14:44:37.342005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '29930367-1d53-439a-84a3-a4896944eabb'} Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29930367-1d53-439a-84a3-a4896944eabb could not be found. Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:44:37.342854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29930367-1d53-439a-84a3-a4896944eabb could not be found. Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29930367-1d53-439a-84a3-a4896944eabb could not be found. Aug 24 14:44:37.344141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:44:37.345269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Returning 404 to user: Instance 29930367-1d53-439a-84a3-a4896944eabb could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:44:37.345269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5593ae31-d5a7-4472-a508-7fc73539ccc3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb" status: 404 len: 111 microversion: 2.1 time: 0.033632 Aug 24 14:44:37.345269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 310/650] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:37 2022] GET /compute/v2.1/servers/29930367-1d53-439a-84a3-a4896944eabb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:44:38.305917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:38.306549 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:38.313153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:38.313634 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:38.314099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:38.314881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:38.315403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:38.315946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:38.455330 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:38.463239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c20d0eef-2b5d-47cd-8218-637dbb0ac614 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.161229 Aug 24 14:44:38.463810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 341/651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:38 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:39.485046 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:39.485612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:39.492465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.493113 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.493547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.494258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:39.494713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:39.495120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:39.631765 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:39.640602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dceaae18-3292-46c6-8fcb-a0ab84a0bba1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.159514 Aug 24 14:44:39.641173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 311/652] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:39 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:40.662916 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:40.663510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:40.670557 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:40.671037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:40.671516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:40.672250 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:40.672704 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:40.673126 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:40.816785 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:40.834419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b3fccb02-bf4e-4e89-b7b1-bbbcf2e5554e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.175231 Aug 24 14:44:40.835018 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 342/653] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:40 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:41.857974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:41.858587 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:41.865460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:41.865985 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:41.866415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:41.867109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:41.867554 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:41.867968 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:42.037247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:42.045862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-312847f6-7550-45dd-b641-1491b63eb9a6 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1677 microversion: 2.1 time: 0.193314 Aug 24 14:44:42.046465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 312/654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:41 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:43.067464 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:43.068247 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:43.075090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.075574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.076106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.076691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.077343 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.077576 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.234142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:43.242379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2cfefaf4-0c1b-48d9-966a-31fdde0909ff tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1654 microversion: 2.1 time: 0.178638 Aug 24 14:44:43.242958 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 343/655] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:43 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1654 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:43.265770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ff704c21-d533-4942-9d86-83c5202bf887 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:43.272639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff704c21-d533-4942-9d86-83c5202bf887 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.272969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff704c21-d533-4942-9d86-83c5202bf887 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.273568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ff704c21-d533-4942-9d86-83c5202bf887 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.276169 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:43.299220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ff704c21-d533-4942-9d86-83c5202bf887 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Going to try to start instance {{(pid=132892) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 14:44:43.527364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ff704c21-d533-4942-9d86-83c5202bf887 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/action" status: 202 len: 0 microversion: 2.1 time: 0.265102 Aug 24 14:44:43.527896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 313/656] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:44:43 2022] POST /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:44:43.539588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:43.540867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:43.547343 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.547863 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.548423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.549128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:43.549918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:43.550389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:43.710932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:43.720054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b31d1a76-829d-4fcf-a017-969a23154b38 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1663 microversion: 2.1 time: 0.185611 Aug 24 14:44:43.720641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 344/657] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:43 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1663 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:44.744958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:44.745653 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:44.752443 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:44.752916 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:44.753377 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:44.754118 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:44.754542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:44.754955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:44.898764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:44.907159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e78d8327-6ea2-4ff8-a637-455fdd83494c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1663 microversion: 2.1 time: 0.166925 Aug 24 14:44:44.907779 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 314/658] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:44 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:45.929921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:45.931077 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:45.937972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.938460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.938897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.939592 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:45.940046 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:45.940488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:45.943292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:46.083156 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:46.092119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3361fd1d-33c4-4d75-ae48-448263878114 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1667 microversion: 2.1 time: 0.166384 Aug 24 14:44:46.092701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 345/659] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:45 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:50.264232 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1650906572", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "networks": [{"uuid": "6e91440f-5ea9-42a5-b494-abdbcfd5be01"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:50.273384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:50.324953 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] validate_networks() for [('6e91440f-5ea9-42a5-b494-abdbcfd5be01', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:44:50.732312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:44:50.732743 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:44:50.733260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:44:50.733674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:44:50.734245 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:44:50.744770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.745255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.745697 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.747195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:50.747195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:50.747524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:50.765876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Getting quotas for project 5ef660ba9b3f42a7aa15458d0a70eb25. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:44:50.771158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Getting quotas for user 565cb12d581c4cc5939ca955b07ae842 and project 5ef660ba9b3f42a7aa15458d0a70eb25. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:44:50.784125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:44:50.786481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:44:50.954079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-895dd00b-cfef-4d64-9378-0abdc88336c5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693697 Aug 24 14:44:50.954744 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 315/660] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:44:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 14:44:50.967142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-fe344085-cf89-415d-a1b5-61138050e803 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:50.967883 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-fe344085-cf89-415d-a1b5-61138050e803 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:51.044575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fe344085-cf89-415d-a1b5-61138050e803 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:51.055896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-fe344085-cf89-415d-a1b5-61138050e803 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1219 microversion: 2.1 time: 0.092425 Aug 24 14:44:51.058161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 346/661] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:50 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:52.077860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c122f158-5c50-4c49-8578-725f6f2bf41b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:52.078481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c122f158-5c50-4c49-8578-725f6f2bf41b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:52.139026 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c122f158-5c50-4c49-8578-725f6f2bf41b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:52.147298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c122f158-5c50-4c49-8578-725f6f2bf41b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1219 microversion: 2.1 time: 0.073816 Aug 24 14:44:52.147877 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 316/662] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:52 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:53.168813 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:53.169486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:53.176502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.176993 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.177433 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.178166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:53.178668 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:53.179089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:53.244644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:53.256584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2a6c3660-30e7-4012-8d19-98bd5947fa3b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1271 microversion: 2.1 time: 0.091605 Aug 24 14:44:53.257621 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 347/663] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:53 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:54.287641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:54.288256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:54.296401 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.296888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:54.297319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.298059 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:54.298503 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:54.298982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:54.370803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:54.379505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7da88e19-26b9-4a4a-8bad-caee7084d76b tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1277 microversion: 2.1 time: 0.095841 Aug 24 14:44:54.380262 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 317/664] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:54 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:55.402085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:55.402737 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:55.405070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=40 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:44:55.410107 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.410593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.411026 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.411730 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.412300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.412737 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.514725 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-ced8e2e8-1275-4e29-9039-2921f2e20c0b req-d85149af-230a-4335-a946-c187b290e20e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c027de8-8bf7-44bc-9441-c7010cc3c49e", "tag": "f2b0841e-cfe1-4249-9c29-1a821b71b759"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:44:55.525165 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-ced8e2e8-1275-4e29-9039-2921f2e20c0b req-d85149af-230a-4335-a946-c187b290e20e service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:55.525640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-ced8e2e8-1275-4e29-9039-2921f2e20c0b req-d85149af-230a-4335-a946-c187b290e20e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:55.526155 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-ced8e2e8-1275-4e29-9039-2921f2e20c0b req-d85149af-230a-4335-a946-c187b290e20e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:55.538321 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-ced8e2e8-1275-4e29-9039-2921f2e20c0b req-d85149af-230a-4335-a946-c187b290e20e service nova] Creating event network-changed:f2b0841e-cfe1-4249-9c29-1a821b71b759 for instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e on hv-cinder-75671 Aug 24 14:44:55.544520 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-ced8e2e8-1275-4e29-9039-2921f2e20c0b req-d85149af-230a-4335-a946-c187b290e20e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033285 Aug 24 14:44:55.545254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 318/665] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:44:55.611577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:55.620846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5d12acdc-1d62-4f62-af95-2b6c05ff0a7a tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.223097 Aug 24 14:44:55.621705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 348/666] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:55 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:56.644231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:56.644909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:56.651948 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.661177 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.661177 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.661177 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:56.661177 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:56.661557 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:56.793525 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:56.801676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4ee0c4db-ebc3-4d84-a068-d87b5a18b348 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.161934 Aug 24 14:44:56.802349 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 319/667] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:56 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:57.077149 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:57.077717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:57.083973 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.084452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.084881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.085580 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.086062 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.087025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.114031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:44:57.517851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e55459e4-0dec-489b-8af7-344c92726fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 204 len: 0 microversion: 2.1 time: 0.550944 Aug 24 14:44:57.518370 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 349/668] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:44:56 2022] DELETE /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:44:57.527539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:57.528285 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:57.534498 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.534965 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.536587 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.536587 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.536587 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.537094 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.679073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:57.687783 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-be2f043a-1df1-4a07-9dff-0c658a4104e1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1578 microversion: 2.1 time: 0.165068 Aug 24 14:44:57.688355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 320/669] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:57 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:57.826243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:57.827007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:57.833525 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.834044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.834477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.835181 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:57.835630 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:57.836046 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:57.976934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:57.985734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d5813476-d61d-4b41-95d6-a1f306aa7906 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.165018 Aug 24 14:44:57.986322 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 350/670] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:57 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:58.709743 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:58.710361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:58.717164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:58.717633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:58.718092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:58.718766 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:58.719205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:58.719618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:58.863632 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:58.872116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-110a36af-b876-4a76-8eb2-f5caedf1613a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1578 microversion: 2.1 time: 0.166306 Aug 24 14:44:58.872702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 321/671] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:58 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:59.007882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:59.009032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:59.015962 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:59.016459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:59.016936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:59.017651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:59.018128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:59.018550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:59.164422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:44:59.173181 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b160ff2c-2058-4170-b996-69fab0739ac7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.169334 Aug 24 14:44:59.174019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 351/672] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:59 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:44:59.895164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:44:59.895795 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:44:59.902860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:59.903346 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:59.903829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:44:59.904539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:44:59.904995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:44:59.905418 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.045216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:00.053114 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7a6e34ff-fbdc-437b-88c5-a6e4a366aa52 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1578 microversion: 2.1 time: 0.162306 Aug 24 14:45:00.053686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 322/673] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:44:59 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:00.196867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:00.197463 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:00.203994 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.204462 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.204896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.205573 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:00.206085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:00.206501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:00.343279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:00.351189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8bc44a35-c65c-4b2e-8c1d-134be302ead8 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.159052 Aug 24 14:45:00.351757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 352/674] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:00 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:01.075713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:01.076329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:01.078379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:01.083955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.084494 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.084875 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.085581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.086067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.087122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.229275 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:01.237084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3cb9a630-dbfe-43ea-9607-752d2229f76c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1578 microversion: 2.1 time: 0.165336 Aug 24 14:45:01.237656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 323/675] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:01 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:01.372679 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:01.373368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:01.375618 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:01.381262 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.393864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.393864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.393864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:01.393864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:01.394352 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:01.530597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:01.538217 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f805a2ec-d367-43f5-a459-9bcb493e42ae tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.169713 Aug 24 14:45:01.538788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 353/676] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:01 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:02.260515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:02.261398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:02.268375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=8 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:02.270075 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.270561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.270985 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.271683 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.272178 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.272591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.561884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:02.562515 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:02.568593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.569074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.569508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.570233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:02.570709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:02.571132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:02.596775 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:02.608375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dd99d814-f8c3-40c2-a42e-68827f22f4fa tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1578 microversion: 2.1 time: 0.352567 Aug 24 14:45:02.609058 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 324/677] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:02 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1578 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:02.866003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:02.876130 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b452be9f-1064-4c7e-b5d8-b99e7376542e tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.319945 Aug 24 14:45:02.876761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 354/678] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:02 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:03.460258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-6adcbae1-d745-4714-b9ca-cc4860477ebe req-eb5f427f-1c22-4cf6-8ec7-b7d34b19e37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7975e08b-1d91-48ec-a6c1-8f783b911af5", "name": "network-vif-deleted", "tag": "91cf19ee-5586-4ad3-b92c-c90e8cfafa8d"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:03.471911 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6adcbae1-d745-4714-b9ca-cc4860477ebe req-eb5f427f-1c22-4cf6-8ec7-b7d34b19e37e service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.473033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6adcbae1-d745-4714-b9ca-cc4860477ebe req-eb5f427f-1c22-4cf6-8ec7-b7d34b19e37e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.473033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6adcbae1-d745-4714-b9ca-cc4860477ebe req-eb5f427f-1c22-4cf6-8ec7-b7d34b19e37e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.486605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-6adcbae1-d745-4714-b9ca-cc4860477ebe req-eb5f427f-1c22-4cf6-8ec7-b7d34b19e37e service nova] Creating event network-vif-deleted:91cf19ee-5586-4ad3-b92c-c90e8cfafa8d for instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 on hv-cinder-75671 Aug 24 14:45:03.492310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-6adcbae1-d745-4714-b9ca-cc4860477ebe req-eb5f427f-1c22-4cf6-8ec7-b7d34b19e37e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035576 Aug 24 14:45:03.492944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 325/679] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:03.632105 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:03.633325 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:03.640151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.641064 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.641676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.642609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.643229 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.643845 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.714869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:03.724054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5a2965ec-5327-43f9-b761-be48a3fbc214 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1510 microversion: 2.1 time: 0.097003 Aug 24 14:45:03.724637 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 355/680] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:03 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:03.902561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:03.903293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:03.917458 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.917780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.923025 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:03.923993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:03.924540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:03.925263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.118876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:04.127646 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fbcfdf9d-be16-46e8-a5ab-9d7cefc77c9f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.232329 Aug 24 14:45:04.146683 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 326/681] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:03 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:04.254731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-528fff92-53ee-4f0b-9a7e-d0f649d8cc2f req-bf7233fc-891a-40ee-bfdc-ac28fae9c0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c027de8-8bf7-44bc-9441-c7010cc3c49e", "name": "network-vif-plugged", "status": "completed", "tag": "f2b0841e-cfe1-4249-9c29-1a821b71b759"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:04.272171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-528fff92-53ee-4f0b-9a7e-d0f649d8cc2f req-bf7233fc-891a-40ee-bfdc-ac28fae9c0a1 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.272329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-528fff92-53ee-4f0b-9a7e-d0f649d8cc2f req-bf7233fc-891a-40ee-bfdc-ac28fae9c0a1 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.273222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-528fff92-53ee-4f0b-9a7e-d0f649d8cc2f req-bf7233fc-891a-40ee-bfdc-ac28fae9c0a1 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.287679 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-528fff92-53ee-4f0b-9a7e-d0f649d8cc2f req-bf7233fc-891a-40ee-bfdc-ac28fae9c0a1 service nova] Creating event network-vif-plugged:f2b0841e-cfe1-4249-9c29-1a821b71b759 for instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e on hv-cinder-75671 Aug 24 14:45:04.293796 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-528fff92-53ee-4f0b-9a7e-d0f649d8cc2f req-bf7233fc-891a-40ee-bfdc-ac28fae9c0a1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116446 Aug 24 14:45:04.295070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 356/682] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:04.748958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:04.749922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:04.756390 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.756997 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.759332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.759332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.759332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.759332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.794395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:04.795179 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:04.795787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:04.796237 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lazy-loading 'fault' on Instance uuid 7975e08b-1d91-48ec-a6c1-8f783b911af5 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:04.853072 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:04.861929 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-954077f1-bb67-4a32-8784-de44dd3b2a96 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 200 len: 1230 microversion: 2.1 time: 0.117839 Aug 24 14:45:04.862515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 327/683] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:04 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 1230 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:05.149729 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:05.151224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:05.158647 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.159129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.159603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.160362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.160813 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.161261 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.327764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:05.340156 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-387dc0a1-bcbd-40fe-b50c-da7d6ce14cfe tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.194601 Aug 24 14:45:05.340744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 357/684] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:05 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:05.888538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:05.889420 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:05.896985 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.897879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.898304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.899071 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:05.899533 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:05.900269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:05.921624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] HTTP exception thrown: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Request method failure captured: Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 HTTP/1.1 Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjgy-gwDpOcTh1HfcjkOUNXHwPeO0sEKmQosjumT3Zr1YIFvz9GZwk1IS4raEBztBs0zkvwXE6HuS0zblJSoQ-FN-dKZHbc54EIFSrCFLYKPxy80WP_KoXagzXMoDFLpnjucPVAsdiaYFH6AoIv7X_qXAMxJuEEkqYZuaQ4_ir-yvWg Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:45:05.924083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}] Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 3b7c54ebd95f4b3eb396982d75615f23 Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:45:05.926724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '7975e08b-1d91-48ec-a6c1-8f783b911af5'} Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:45:05.929260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:45:05.934268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:05.939009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Returning 404 to user: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:45:05.939009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39471e10-9a21-4fb9-80f3-378f6134a521 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 404 len: 111 microversion: 2.1 time: 0.043006 Aug 24 14:45:05.939009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 328/685] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:05 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:45:05.995294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2066259502", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-624897609", "security_groups": [{"name": "tempest-secgroup-smoke-1621191805"}], "block_device_mapping_v2": [{"uuid": "6db01299-05bd-473f-8a9c-9228d16074f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2213b9d9-5655-4f75-b8cc-83ad6d8a04df"}]}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:06.163168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] validate_networks() for [('2213b9d9-5655-4f75-b8cc-83ad6d8a04df', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:45:06.363187 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:06.364016 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:06.372742 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:06.377979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:06.377979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:06.377979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:06.377979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:06.378379 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:06.613223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:06.627615 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-066156cf-a230-4e18-a845-86073c4f32b3 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1319 microversion: 2.1 time: 0.267837 Aug 24 14:45:06.642842 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 329/686] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:06 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:06.730817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:45:06.731289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:45:06.731762 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:45:06.732173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:45:06.732590 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:45:06.746448 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:06.746938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:06.747369 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:06.748102 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:06.748557 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:06.749055 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:06.769197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Getting quotas for project f22a1cf1a07c47a29772e70e4586a77b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:45:06.773496 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Getting quotas for user 3b7c54ebd95f4b3eb396982d75615f23 and project f22a1cf1a07c47a29772e70e4586a77b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:45:06.835905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:45:06.838689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6db01299-05bd-473f-8a9c-9228d16074f8',volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:45:07.340225 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-92b18df7-5a99-432e-aff9-36a036a17556 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.352384 Aug 24 14:45:07.342313 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 358/687] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:45:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:45:07.354959 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d5406d9-52a1-42f3-b6a4-0824b8c7ebc2 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:07.357023 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8d5406d9-52a1-42f3-b6a4-0824b8c7ebc2 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:07.421897 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8d5406d9-52a1-42f3-b6a4-0824b8c7ebc2 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:07.431492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8d5406d9-52a1-42f3-b6a4-0824b8c7ebc2 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1094 microversion: 2.1 time: 0.082066 Aug 24 14:45:07.433172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 330/688] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:07 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:07.656192 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:07.657193 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:07.663791 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:07.664274 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:07.664712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:07.665418 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:07.666600 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:07.667088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:07.814050 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:07.823189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0fc98f36-0594-4449-8257-19a45f3df8d1 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1508 microversion: 2.1 time: 0.173659 Aug 24 14:45:07.823777 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 359/689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:07 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:07.858641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b2d4255-4bd7-47f4-9e96-c4bf2378cb2c", "device": "/dev/sdb"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:07.861052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:07.867736 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:07.868213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:07.869346 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:07.870855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:07.870855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:07.870855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.455240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:08.455240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:08.461044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:08.461555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:08.462017 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.463906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:08.464404 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:08.464845 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:08.532031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:08.540036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2bcec603-f893-4681-acf8-11236ce050ea tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1144 microversion: 2.1 time: 0.090589 Aug 24 14:45:08.540665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 360/690] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:08 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:08.685287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:08.795479 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aa1fad32-7b34-4488-822d-152bdfbffb60 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "POST /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.941127 Aug 24 14:45:08.796097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 331/691] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:45:07 2022] POST /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e/os-volume_attachments => generated 194 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:09.562018 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:09.562715 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:09.569151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:09.569639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:09.570109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:09.570807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:09.571260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:09.571685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:09.638320 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:09.646202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-db3badf8-8998-4c6f-8a20-41dd87ea4762 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1192 microversion: 2.1 time: 0.088219 Aug 24 14:45:09.649617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 361/692] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:09 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:10.670175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:10.670920 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:10.683941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:10.684437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:10.684877 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:10.685600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:10.686164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:10.686612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:10.755680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:10.766260 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7b898b47-c473-4314-9bb9-524a955ec84b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1210 microversion: 2.1 time: 0.101986 Aug 24 14:45:10.766833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 332/693] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:10 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:11.789323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:11.799275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:11.799275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:11.799275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:11.799275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:11.799689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:11.799689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:11.800120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:11.817110 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:11.967949 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:11.977317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-27cd264c-5a6c-4a12-93cb-9b0c8a331a9d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.191842 Aug 24 14:45:11.978822 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 362/694] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:11 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:12.260797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-507f4907-000c-48d3-a884-0e8978410944 req-9d569859-024a-472a-85c3-0a9e3e0c62a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766832e0-abd0-4e53-9f72-40b0a5456b9f", "tag": "6aebd7fb-4731-46dc-b25e-7890dafadc78"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:12.273141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-507f4907-000c-48d3-a884-0e8978410944 req-9d569859-024a-472a-85c3-0a9e3e0c62a8 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:12.273612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-507f4907-000c-48d3-a884-0e8978410944 req-9d569859-024a-472a-85c3-0a9e3e0c62a8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:12.274056 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-507f4907-000c-48d3-a884-0e8978410944 req-9d569859-024a-472a-85c3-0a9e3e0c62a8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:12.286228 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-507f4907-000c-48d3-a884-0e8978410944 req-9d569859-024a-472a-85c3-0a9e3e0c62a8 service nova] Creating event network-changed:6aebd7fb-4731-46dc-b25e-7890dafadc78 for instance 766832e0-abd0-4e53-9f72-40b0a5456b9f on hv-cinder-75671 Aug 24 14:45:12.290868 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-507f4907-000c-48d3-a884-0e8978410944 req-9d569859-024a-472a-85c3-0a9e3e0c62a8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102569 Aug 24 14:45:12.291739 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 333/695] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:12.999905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:13.000560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:13.008374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:13.008807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:13.009200 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:13.010513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:13.010780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:13.011204 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:13.171273 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:13.182734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cccd88af-2e11-41e9-bd34-08ab91131080 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.185126 Aug 24 14:45:13.182734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 363/696] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:12 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:14.205488 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:14.206253 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:14.212938 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:14.213557 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:14.214062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:14.214774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:14.215247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:14.215692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:14.370202 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:14.378467 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bb610244-39d4-4e3e-8bca-4b6a485c3b00 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.177700 Aug 24 14:45:14.378971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 334/697] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:14 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:15.399752 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:15.401368 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:15.407798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:15.408276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:15.408709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:15.409397 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:15.409867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:15.410289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:15.552879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:15.562184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-15969ed4-49fb-4e64-a75e-9039cb0429b4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.165823 Aug 24 14:45:15.562778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 364/698] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:15 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:16.586258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:16.586875 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:16.595119 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:16.595594 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:16.596030 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:16.596733 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:16.597224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:16.597649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:16.741968 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:16.750269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cf40773a-8e7e-4e7c-b361-64929f6e10a1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.168540 Aug 24 14:45:16.754030 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 335/699] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:16 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:17.057803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:17.058353 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:17.060665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:17.061329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=6 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:17.066203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.066685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.067118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.067804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.068251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.068700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.097904 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-36e408fd-32de-491d-b503-02c451e448c2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments/8f3031dc-bed3-4493-9b33-07c7bcbb342e" status: 200 len: 194 microversion: 2.20 time: 0.044655 Aug 24 14:45:17.098489 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 365/700] 10.222.0.65 () {60 vars in 1454 bytes} [Wed Aug 24 14:45:17 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments/8f3031dc-bed3-4493-9b33-07c7bcbb342e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:17.174585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:17.175085 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:17.183334 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.183848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.184276 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.184964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.185404 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.185839 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.277710 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lazy-loading 'services' on Instance uuid 687c842a-2354-49c5-9c12-165babf4a0d6 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:17.426872 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:17.613267 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4c7e954c-a31c-4bd1-8fd0-c01cc9364a2b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "DELETE /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments/8f3031dc-bed3-4493-9b33-07c7bcbb342e" status: 202 len: 0 microversion: 2.20 time: 0.443151 Aug 24 14:45:17.614015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 336/701] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 24 14:45:17 2022] DELETE /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments/8f3031dc-bed3-4493-9b33-07c7bcbb342e => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:45:17.627719 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:17.631757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:17.639916 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.640403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.640834 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.641540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.642024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.642485 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.673700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5f297922-4bb6-49f8-993b-05497916a3dd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054757 Aug 24 14:45:17.674301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 366/702] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:17 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:17.774762 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:17.775439 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:17.783055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.783537 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.783960 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.784677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:17.785141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:17.785553 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:17.946652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:17.954969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bee309c2-e033-4bcd-be64-02817ac051bf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.184359 Aug 24 14:45:17.955551 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 337/703] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:17 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:18.686460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:18.688645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:18.696147 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:18.697244 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:18.697727 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:18.698452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:18.698904 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:18.699327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:18.728635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ecd04494-f318-4b4a-ab7f-ecb3e7225fb9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046056 Aug 24 14:45:18.729468 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 367/704] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:18 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:18.978265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:18.979619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:18.988422 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:18.989222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:18.989982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:18.991154 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:18.991708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:18.992956 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:19.147078 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:19.154927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-49a57da7-8fc4-4a7c-b4ff-12dd350176ce tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.181463 Aug 24 14:45:19.155505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 338/705] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:18 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:19.741443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:19.743703 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:19.753728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:19.753728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:19.753728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:19.753728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:19.754228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:19.754228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:19.784769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c8a90cd7-9277-4972-8de8-4ae16652cad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047395 Aug 24 14:45:19.785382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 368/706] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:19 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:20.177641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:20.178278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:20.185110 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:20.185618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:20.186091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:20.186788 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:20.187242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:20.187668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:20.339892 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:20.347882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a68aae54-0872-4b32-a071-1ffcee529513 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.174178 Aug 24 14:45:20.348462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 339/707] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:20 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:20.797799 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:20.799943 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:20.807318 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:20.807802 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:20.808235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:20.808948 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:20.809401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:20.809853 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:20.843080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-37c9a770-6c6c-4647-ab4d-ae0889edd44e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049294 Aug 24 14:45:20.843658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 369/708] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:20 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:21.370960 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:21.371638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:21.374570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:21.379691 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:21.380167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:21.380624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:21.381346 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:21.381882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:21.382312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:21.515274 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:21.523277 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8f66b45a-9dc6-4c5c-847a-3dd99cc11aaf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.157090 Aug 24 14:45:21.523856 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 340/709] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:21 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:21.858577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:21.860740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:21.867720 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:21.868224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:21.868641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:21.869339 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:21.869843 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:21.870268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:21.901239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-48bee75e-d270-4205-931f-b77e84dbe30a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047494 Aug 24 14:45:21.901824 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 370/710] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:21 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:22.544649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:22.545254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:22.551727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:22.552207 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:22.552663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:22.553348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:22.553818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:22.554241 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:22.693306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:22.701072 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-471b1f2e-ff9f-4f5e-a3a3-bb48704fc5f3 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1278 microversion: 2.1 time: 0.160562 Aug 24 14:45:22.701633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 341/711] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:22 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:22.914909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:22.917811 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:22.924140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:22.924614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:22.925044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:22.925818 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:22.926271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:22.926692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:22.956999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-84b9d335-921d-4c62-a03b-f9e7b451c692 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046232 Aug 24 14:45:22.957587 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 371/712] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:22 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:23.722985 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:23.723601 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:23.731011 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:23.731507 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:23.731948 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:23.732651 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:23.733103 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:23.733531 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:23.871536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:23.879757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7b61d7d0-2aa1-47ff-8e18-1c44f6aba1a0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.161406 Aug 24 14:45:23.880400 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 342/713] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:23 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:23.973582 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:23.976719 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:23.983851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:23.984360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:23.984795 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:23.985734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:23.986033 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:23.986472 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:24.022374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c5696a91-a603-48e2-b2a3-876ade23827b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056248 Aug 24 14:45:24.022937 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 372/714] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:23 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:24.905676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:24.906493 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:24.914649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:24.915236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:24.916222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:24.916988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:24.917474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:24.917961 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:25.034793 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:25.037917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:25.045070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:25.046068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:25.046244 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:25.047135 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:25.047747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:25.048264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:25.073410 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:25.082913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ebb08dea-c880-4ccb-8b22-4c77f17c8b0e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.184026 Aug 24 14:45:25.083681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 343/715] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:24 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:25.084480 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2e59ab17-40fb-49c6-852c-48531e3d4224 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053829 Aug 24 14:45:25.085067 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 373/716] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:25 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:26.098587 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:26.100871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:26.107523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:26.108140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:26.108808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:26.109361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:26.109855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:26.110565 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:26.110688 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:26.111029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:26.111457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:26.115297 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:26.115781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:26.116212 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:26.116918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:26.117367 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:26.117807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:26.145637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9437a59d-1acc-4fb1-a0b4-9fec46efa615 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050980 Aug 24 14:45:26.146579 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 344/717] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:26 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:26.266382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:26.274903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b38e6256-8ee8-4d84-a062-0efcbd9a1ddb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.172199 Aug 24 14:45:26.279830 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 374/718] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:26 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:27.159006 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:27.161172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:27.168572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:27.169087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:27.169525 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:27.170263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:27.170715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:27.171160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:27.204084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-18d910d8-32ef-4cde-bd42-0b363e1c62b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048994 Aug 24 14:45:27.204683 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 345/719] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:27 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:27.297233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:27.297868 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:27.304424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:27.304910 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:27.305345 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:27.306069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:27.306576 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:27.307509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:27.448139 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:27.455642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dbdd7a75-5130-421e-890e-eb578759620b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.162592 Aug 24 14:45:27.456249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 375/720] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:27 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:28.217976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:28.220049 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:28.229886 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:28.230535 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:28.231193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:28.232226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:28.233010 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:28.233698 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:28.269842 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b0deacb9-8ad5-4cb1-a118-3aa79595f9b9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056776 Aug 24 14:45:28.270463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 346/721] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:28 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:28.476836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:28.477365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:28.486061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:28.486545 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:28.486973 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:28.487670 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:28.488118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:28.488534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:28.637809 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:28.645842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d2441474-8bdd-42a3-8287-2a5f8bb70071 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.172975 Aug 24 14:45:28.646428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 376/722] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:28 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:29.283013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:29.285152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:29.292544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:29.293020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:29.293452 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:29.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:29.294625 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:29.295042 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:29.327104 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a29eb71c-d447-4fb2-ba0b-2eeaa912dbed tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048050 Aug 24 14:45:29.327679 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 347/723] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:29 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:29.670779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:29.671465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:29.678532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:29.679005 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:29.679437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:29.680219 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:29.680665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:29.681082 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:29.833884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:29.843276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-86cf2f13-be8a-4dec-8e06-3028513a2fd0 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.177726 Aug 24 14:45:29.843849 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 377/724] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:29 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:30.340823 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:30.343090 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:30.350046 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:30.350540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:30.350976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:30.351682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:30.352212 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:30.352656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:30.367474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:30.383709 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-12c68896-23e2-4bbe-8b21-b8f742935500 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047848 Aug 24 14:45:30.384280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 348/725] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:30 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:30.865338 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:30.865975 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:30.872435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:30.872920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:30.873351 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:30.874070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:30.874530 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:30.874944 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:31.018083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:31.028968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d9159637-2b54-4685-869f-a3d963816bba tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.167428 Aug 24 14:45:31.031069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 378/726] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:30 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:31.397345 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:31.399766 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:31.407787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:31.408294 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:31.408802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:31.409475 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:31.410097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:31.410516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:31.443009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e45edd66-e04c-476d-bc72-e02c247fdb2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050141 Aug 24 14:45:31.443572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 349/727] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:31 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:45:32.050326 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:32.051108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:32.059281 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.059792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.060240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:32.060979 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.061432 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.061886 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:32.064856 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:32.230693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:32.239142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-31a129dd-0abf-43c8-82a6-91d236da0487 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.192698 Aug 24 14:45:32.240540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 379/728] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:32 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:32.455619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:32.457734 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:32.465306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.465804 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.466239 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:32.466931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.467385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.467807 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:32.499793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-59b513ea-55fe-49e3-a8c0-665579119ad9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048092 Aug 24 14:45:32.500367 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 350/729] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:45:32 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:32.564801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:32.565302 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:32.571901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.572671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.573186 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:32.577717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.577717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.577717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:32.600979 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:45:32.916838 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8c1374a7-e5bd-444b-99ba-b9a58567415e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "DELETE /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 204 len: 0 microversion: 2.20 time: 0.355642 Aug 24 14:45:32.917354 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 380/730] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 24 14:45:32 2022] DELETE /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:45:32.925946 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:32.926562 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:32.933781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.934278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.934701 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:32.935399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:32.935885 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:32.936294 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:33.091955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:33.101265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:33.102814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:33.104462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1028b4df-1616-44cc-8988-953ec3b230d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.182472 Aug 24 14:45:33.105064 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 351/731] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:32 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:45:33.262863 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:33.263549 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:33.270254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:33.270746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:33.271178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:33.271897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:33.272348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:33.272776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:33.429283 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:33.438877 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8cc59a95-c984-4236-a413-a9e5066bb956 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.181154 Aug 24 14:45:33.439476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 381/732] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:33 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:34.128662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:34.129250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:34.136514 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:34.137057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:34.137492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:34.138314 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:34.138782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:34.140332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:34.284847 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:34.294971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:34.296543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:34.297709 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e5708b4f-80cf-42f4-aec8-13c432151cfb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.173105 Aug 24 14:45:34.298310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 352/733] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:34 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:34.454519 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-5c2d36eb-7e11-4cab-a3a0-c7241b9013ff req-d65e7c99-dcdd-4c4c-ab91-5cd220554837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766832e0-abd0-4e53-9f72-40b0a5456b9f", "name": "network-vif-plugged", "status": "completed", "tag": "6aebd7fb-4731-46dc-b25e-7890dafadc78"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:34.463322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:34.464293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:34.465674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5c2d36eb-7e11-4cab-a3a0-c7241b9013ff req-d65e7c99-dcdd-4c4c-ab91-5cd220554837 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:34.467021 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5c2d36eb-7e11-4cab-a3a0-c7241b9013ff req-d65e7c99-dcdd-4c4c-ab91-5cd220554837 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:34.467486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-5c2d36eb-7e11-4cab-a3a0-c7241b9013ff req-d65e7c99-dcdd-4c4c-ab91-5cd220554837 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:34.470684 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:34.471239 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:34.471785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:34.472551 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:34.473066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:34.473562 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:34.479636 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-5c2d36eb-7e11-4cab-a3a0-c7241b9013ff req-d65e7c99-dcdd-4c4c-ab91-5cd220554837 service nova] Creating event network-vif-plugged:6aebd7fb-4731-46dc-b25e-7890dafadc78 for instance 766832e0-abd0-4e53-9f72-40b0a5456b9f on hv-cinder-75671 Aug 24 14:45:34.485248 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-5c2d36eb-7e11-4cab-a3a0-c7241b9013ff req-d65e7c99-dcdd-4c4c-ab91-5cd220554837 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Aug 24 14:45:34.485946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 382/734] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:34.593051 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:34.593843 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:34.601132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:34.601623 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:34.602857 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:34.604766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:34.605237 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:34.606282 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:34.643030 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:34.651386 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4de28ce4-3643-4142-ad37-71a977145835 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.192877 Aug 24 14:45:34.655216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 353/735] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:34 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:34.697865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lazy-loading 'services' on Instance uuid 4c027de8-8bf7-44bc-9441-c7010cc3c49e {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:34.953032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-489c4350-16f6-4fdd-8cc0-0396bcc7919f tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e/os-volume_attachments/9b2d4255-4bd7-47f4-9e96-c4bf2378cb2c" status: 202 len: 0 microversion: 2.1 time: 0.364209 Aug 24 14:45:34.953586 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 383/736] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:45:34 2022] DELETE /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e/os-volume_attachments/9b2d4255-4bd7-47f4-9e96-c4bf2378cb2c => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:45:35.321169 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:35.324019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:35.331107 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:35.331593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:35.332125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:35.332862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:35.333516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:35.333993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:35.569270 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:35.578819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:35.580331 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:35.581597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c07d9217-0a12-43f5-9b06-30d25030f32a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1721 microversion: 2.20 time: 0.264468 Aug 24 14:45:35.582183 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 354/737] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:35 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:35.675098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:35.675817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:35.684850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:35.685347 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:35.685806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:35.686550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:35.687007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:35.687435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:36.200408 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:36.209251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a57ef7e1-16cb-4501-9090-69351f8802bc tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1266 microversion: 2.1 time: 0.539721 Aug 24 14:45:36.227195 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 384/738] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:35 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1266 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:36.429328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-0f6afc11-c014-4a5f-b627-f8248ef70b51 req-eb32fe06-ebc8-424b-bed6-b7251fb696dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687c842a-2354-49c5-9c12-165babf4a0d6", "name": "network-vif-deleted", "tag": "e937f76f-4ef7-4572-b805-b6918a000637"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:36.439258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-0f6afc11-c014-4a5f-b627-f8248ef70b51 req-eb32fe06-ebc8-424b-bed6-b7251fb696dc service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:36.439739 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-0f6afc11-c014-4a5f-b627-f8248ef70b51 req-eb32fe06-ebc8-424b-bed6-b7251fb696dc service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:36.440163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-0f6afc11-c014-4a5f-b627-f8248ef70b51 req-eb32fe06-ebc8-424b-bed6-b7251fb696dc service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:36.451297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-0f6afc11-c014-4a5f-b627-f8248ef70b51 req-eb32fe06-ebc8-424b-bed6-b7251fb696dc service nova] Creating event network-vif-deleted:e937f76f-4ef7-4572-b805-b6918a000637 for instance 687c842a-2354-49c5-9c12-165babf4a0d6 on hv-cinder-75671 Aug 24 14:45:36.456654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-0f6afc11-c014-4a5f-b627-f8248ef70b51 req-eb32fe06-ebc8-424b-bed6-b7251fb696dc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031534 Aug 24 14:45:36.457259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 355/739] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:36.609918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:36.610440 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:36.616800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:36.617287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:36.617712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:36.618440 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:36.619590 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:36.620314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:36.689226 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:36.698789 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:36.700334 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:36.701610 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-65ba48ee-e64a-4268-9dba-f452059c0b28 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1653 microversion: 2.20 time: 0.096044 Aug 24 14:45:36.702625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 385/740] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:36 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1653 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:37.236192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:37.237450 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:37.246613 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:37.247099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:37.247528 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:37.248456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:37.248670 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:37.249087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:37.406656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:37.416060 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6d4fab6f-914b-4a17-8d3f-25d95c95cc09 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1454 microversion: 2.1 time: 0.188371 Aug 24 14:45:37.416744 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 356/741] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:37 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:37.437977 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:37.438577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:37.444805 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:37.445831 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:37.446473 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:37.448118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:37.448577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:37.448999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:37.611178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:37.623788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5477b184-4372-42a1-a371-1687263ad9b9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1454 microversion: 2.1 time: 0.189558 Aug 24 14:45:37.624597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 386/742] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:37 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:37.725038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:37.725667 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:37.733639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:37.734162 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:37.734596 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:37.735305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:37.735756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:37.736181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:37.773624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:37.774541 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:37.775506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:37.776577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lazy-loading 'fault' on Instance uuid 687c842a-2354-49c5-9c12-165babf4a0d6 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:37.841535 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:37.853082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:37.855351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:37.856527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-99c28020-9b37-4662-9b8a-cfc772a7efb8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 200 len: 1369 microversion: 2.20 time: 0.135527 Aug 24 14:45:37.857135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 357/743] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:37 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 1369 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:38.258825 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:38.273083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:38.273083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:38.273083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:38.273083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:38.274604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:38.274604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:38.274604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:38.303696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:45:38.687205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-636b4c3d-583a-4190-8a32-bf9337e1447c tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 204 len: 0 microversion: 2.1 time: 0.437975 Aug 24 14:45:38.688386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 387/744] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:45:38 2022] DELETE /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:45:38.704798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:38.705788 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:38.715876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:38.716736 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:38.717656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:38.718906 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:38.719686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:38.720449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:38.882321 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:38.882938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:38.889299 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:38.889817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:38.890256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:38.891235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:38.891693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:38.892122 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:38.907206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] HTTP exception thrown: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Request method failure captured: Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 HTTP/1.1 Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfLNPd_3oFfbsaxfFTOk1z6OyVAy2ab0CnmENfb-n30XdcQa5d3DAspbQGlS9BrWkm1uWIzV893zqdtSO5gsZoU2V6mplqPGt2s67fFTLEa4-eb8GPrTVg_OUrC4n_-Z2bEfRZ-6ZgV0vwIJ_V-q7kom2jwz0Ih2o7mmscU5wu_Tgo Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:45:38.908826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}] Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: fbdf19910c234794b8aeb480dba50d85 Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:45:38.918988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '687c842a-2354-49c5-9c12-165babf4a0d6'} Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:45:38.920869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:45:38.923562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:38.927257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Returning 404 to user: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:45:38.927257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8b4ddec9-1811-46de-9f43-35137f791fc1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 404 len: 111 microversion: 2.20 time: 0.032858 Aug 24 14:45:38.927257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 388/745] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:38 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 14:45:38.927257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-32700421-986f-49a4-83d5-61f3569352a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '.version_select at 0x7fbf7c332c10>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:38.933572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:38.948994 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-28528ad6-de7b-486a-8956-26bec622eca5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1514 microversion: 2.1 time: 0.251905 Aug 24 14:45:38.950303 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 358/746] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:38 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:39.077236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-32700421-986f-49a4-83d5-61f3569352a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455384548" status: 204 len: 0 microversion: 2.20 time: 0.161709 Aug 24 14:45:39.077993 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 389/747] 10.222.0.65 () {60 vars in 1259 bytes} [Wed Aug 24 14:45:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455384548 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 14:45:39.987640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:39.988264 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:39.998707 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:39.999775 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:40.000377 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:40.001239 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:40.001950 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:40.002366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:40.026076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-2de0b410-499b-465d-b767-555417d070f9 req-72cc5388-6295-4b55-ac78-f08b77c9f375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766832e0-abd0-4e53-9f72-40b0a5456b9f", "tag": "6aebd7fb-4731-46dc-b25e-7890dafadc78"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:40.046079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2de0b410-499b-465d-b767-555417d070f9 req-72cc5388-6295-4b55-ac78-f08b77c9f375 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:40.046885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2de0b410-499b-465d-b767-555417d070f9 req-72cc5388-6295-4b55-ac78-f08b77c9f375 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:40.047811 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2de0b410-499b-465d-b767-555417d070f9 req-72cc5388-6295-4b55-ac78-f08b77c9f375 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:40.068038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-2de0b410-499b-465d-b767-555417d070f9 req-72cc5388-6295-4b55-ac78-f08b77c9f375 service nova] Creating event network-changed:6aebd7fb-4731-46dc-b25e-7890dafadc78 for instance 766832e0-abd0-4e53-9f72-40b0a5456b9f on hv-cinder-75671 Aug 24 14:45:40.085072 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-2de0b410-499b-465d-b767-555417d070f9 req-72cc5388-6295-4b55-ac78-f08b77c9f375 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067175 Aug 24 14:45:40.086164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 390/748] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:45:40.129917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-46a56285-5874-49b9-959c-f50a37ff8f1c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'create', calling method: .version_select at 0x7fbf7836bf70>, body: {"keypair": {"name": "tempest-keypair-640105388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1MB4HHoXfsRzRKmTEQqqlDQD/xFXrAAHiptRK+9WTQAAR7c8PZFCYX2Xy2zfHmhBrScs+5T8iYuiMPJtfdIvk0CupQDu7fnOsJmjj/LaaIl3LohMd9pLyAru7ViCJmqw=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:40.150961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-46a56285-5874-49b9-959c-f50a37ff8f1c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Getting quotas for project 25aaf7039f994f4a83bf8ce6db68f3a1. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:45:40.155852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-46a56285-5874-49b9-959c-f50a37ff8f1c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Getting quotas for user fbdf19910c234794b8aeb480dba50d85 and project 25aaf7039f994f4a83bf8ce6db68f3a1. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:45:40.245607 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:40.254347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d40313d0-0a56-4779-b6ea-7e9c35af6013 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1514 microversion: 2.1 time: 0.273000 Aug 24 14:45:40.265911 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 359/749] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:39 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:40.300653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-46a56285-5874-49b9-959c-f50a37ff8f1c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.179399 Aug 24 14:45:40.301392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 391/750] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 24 14:45:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 14:45:41.279698 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:41.280558 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:41.287403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:41.287878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:41.290957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:41.290957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:41.290957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:41.290957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:41.536042 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:41.545286 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-630aab5c-847d-4054-ba95-e64231aa4502 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1514 microversion: 2.1 time: 0.269803 Aug 24 14:45:41.546001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 360/751] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:41 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:41.705147 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-d510fdf9-597b-47a8-8e3d-27bc717231e6 req-23aeaeb0-f983-46b0-8661-1a392b7c6019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c027de8-8bf7-44bc-9441-c7010cc3c49e", "name": "network-vif-deleted", "tag": "f2b0841e-cfe1-4249-9c29-1a821b71b759"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:41.719312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-d510fdf9-597b-47a8-8e3d-27bc717231e6 req-23aeaeb0-f983-46b0-8661-1a392b7c6019 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:41.722016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-d510fdf9-597b-47a8-8e3d-27bc717231e6 req-23aeaeb0-f983-46b0-8661-1a392b7c6019 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:41.722016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-d510fdf9-597b-47a8-8e3d-27bc717231e6 req-23aeaeb0-f983-46b0-8661-1a392b7c6019 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:41.733164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-d510fdf9-597b-47a8-8e3d-27bc717231e6 req-23aeaeb0-f983-46b0-8661-1a392b7c6019 service nova] Creating event network-vif-deleted:f2b0841e-cfe1-4249-9c29-1a821b71b759 for instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e on hv-cinder-75671 Aug 24 14:45:41.739035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-d510fdf9-597b-47a8-8e3d-27bc717231e6 req-23aeaeb0-f983-46b0-8661-1a392b7c6019 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039769 Aug 24 14:45:41.739674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 392/752] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:42.568611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:42.569251 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:42.578631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:42.579436 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:42.579923 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:42.580703 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:42.581509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:42.582143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:42.617027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:42.617905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:42.618144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:42.618396 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lazy-loading 'fault' on Instance uuid 4c027de8-8bf7-44bc-9441-c7010cc3c49e {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:42.682634 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565cb12d581c4cc5939ca955b07ae842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef660ba9b3f42a7aa15458d0a70eb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:42.690789 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a687bc9b-d35f-40df-b83d-3387ce0b81a7 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 200 len: 1309 microversion: 2.1 time: 0.126061 Aug 24 14:45:42.691390 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 361/753] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:42 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:43.463809 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:43.470997 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:43.474279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:43.475047 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:43.475499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:43.476276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:43.476752 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:43.477178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:43.574118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lazy-loading 'services' on Instance uuid 3d040cfc-ac45-4941-b04f-a8ba0f061929 {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:43.634486 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-222668476", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "553ca834-cedd-40ba-ae2f-786373c0276f"}], "security_groups": [{"name": "tempest-securitygroup--739881646"}], "key_name": "tempest-keypair-640105388", "user_data": "}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:43.749294 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] validate_networks() for [('553ca834-cedd-40ba-ae2f-786373c0276f', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:45:43.784589 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8f453888-e6a2-441b-9c20-83057e5e2177 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments/df2b1835-c052-488e-8f8e-50de55c0f191" status: 202 len: 0 microversion: 2.1 time: 0.325609 Aug 24 14:45:43.785257 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 393/754] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:45:43 2022] DELETE /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments/df2b1835-c052-488e-8f8e-50de55c0f191 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:45:43.791619 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:43.792326 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] [instance: 4c027de8-8bf7-44bc-9441-c7010cc3c49e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:43.799099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:43.799748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:43.800183 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:43.800893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:43.801346 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:43.801788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:43.819092 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] HTTP exception thrown: Instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e could not be found. Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Request method failure captured: Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e HTTP/1.1 Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjj5cInX8esdMwUrQGVNwcctpKWgC_-4HEIzQhWxv5CmD765QVT_5p3FIEz-pe2PyJAKcczqnJnu4hlRJvhlD54bLSw1S-6ijvwkNTKph91BqJsZin-2NJzxzkUWNsl1d2wBGTE0MgSzA4htGJMTPa9v2Oezrb7H_B4_SoYTlnAAn94 Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 5ef660ba9b3f42a7aa15458d0a70eb25 Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-VolumesSnapshotTestJSON-884119791 Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:45:43.820996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5ef660ba9b3f42a7aa15458d0a70eb25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5ef660ba9b3f42a7aa15458d0a70eb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5ef660ba9b3f42a7aa15458d0a70eb25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5ef660ba9b3f42a7aa15458d0a70eb25"}]}] Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-VolumesSnapshotTestJSON-884119791 Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 5ef660ba9b3f42a7aa15458d0a70eb25 Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-884119791 Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-VolumesSnapshotTestJSON-884119791-project Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 565cb12d581c4cc5939ca955b07ae842 Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-VolumesSnapshotTestJSON-884119791-project Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e could not be found. Aug 24 14:45:43.824042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '4c027de8-8bf7-44bc-9441-c7010cc3c49e'} Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e could not be found. Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:45:43.825960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e could not be found. Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e could not be found. Aug 24 14:45:43.827685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:45:43.829109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] Returning 404 to user: Instance 4c027de8-8bf7-44bc-9441-c7010cc3c49e could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:45:43.829109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f4113907-a700-41a2-9cff-57b5ced2a4a5 tempest-VolumesSnapshotTestJSON-884119791 tempest-VolumesSnapshotTestJSON-884119791-project] 10.222.0.65 "GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e" status: 404 len: 111 microversion: 2.1 time: 0.036180 Aug 24 14:45:43.829109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 394/755] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:43 2022] GET /compute/v2.1/servers/4c027de8-8bf7-44bc-9441-c7010cc3c49e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:45:43.837901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:43.842749 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:43.849768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:43.850385 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:43.850956 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:43.851792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:43.852340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:43.852885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:43.888884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4900dae6-0d7e-4d6b-8eeb-abeeae7a72fe tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058706 Aug 24 14:45:43.889475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 395/756] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:45:43 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:44.259558 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:45:44.260609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:45:44.261206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:45:44.261674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:45:44.262255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:45:44.279885 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:44.280816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:44.280816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:44.281582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:44.281991 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:44.282466 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:44.300750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Getting quotas for project 25aaf7039f994f4a83bf8ce6db68f3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:45:44.305382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Getting quotas for user fbdf19910c234794b8aeb480dba50d85 and project 25aaf7039f994f4a83bf8ce6db68f3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:45:44.318949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:45:44.321289 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:45:44.438751 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ec4d85b9-681b-41dc-b35a-bcca8840262a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.808532 Aug 24 14:45:44.439271 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 362/757] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 24 14:45:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 14:45:44.450927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-845bd6a2-bd70-4289-8089-5f73304f3660 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:44.451806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-845bd6a2-bd70-4289-8089-5f73304f3660 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:44.528127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-845bd6a2-bd70-4289-8089-5f73304f3660 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:44.538998 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-845bd6a2-bd70-4289-8089-5f73304f3660 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:44.542789 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-845bd6a2-bd70-4289-8089-5f73304f3660 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:44.544373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-845bd6a2-bd70-4289-8089-5f73304f3660 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1280 microversion: 2.20 time: 0.097835 Aug 24 14:45:44.546141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 396/758] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:44 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:44.901911 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:44.904256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:44.911716 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:44.912208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:44.912724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:44.913437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:44.913929 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:44.914382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:44.954515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39474bcf-226b-48e9-9bf4-b71ec1eddc70 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057486 Aug 24 14:45:44.955023 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 363/759] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:45:44 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:45.568138 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:45.568747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:45.577847 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:45.578488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:45.578955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:45.584316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:45.584844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:45.585291 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:45.604150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:45.665011 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:45.673271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:45.674926 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:45.676037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2e979011-1402-4faf-bef2-3eccbca173f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1284 microversion: 2.20 time: 0.111830 Aug 24 14:45:45.676587 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 397/760] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:45 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:45.968681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:45.970881 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:45.977885 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:45.979019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:45.979752 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:45.980964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:45.981502 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:45.982277 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:46.013987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-da73c3b9-c905-4150-8aa9-5d2060f26fb9 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049663 Aug 24 14:45:46.014582 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 364/761] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:45:45 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:45:46.096803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:46.097301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:46.104391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:46.104874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:46.105349 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:46.106074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:46.106523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:46.106943 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:46.133027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:45:46.494658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-59d03cca-d999-49dd-9f01-c6c57c85bc5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 204 len: 0 microversion: 2.1 time: 0.402168 Aug 24 14:45:46.495332 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 398/762] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:45:46 2022] DELETE /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:45:46.503988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:46.504599 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:46.511313 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:46.511798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:46.512232 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:46.512921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:46.513366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:46.513813 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:46.663823 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:46.663823 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:46.675620 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-63c70a2d-d895-4787-b652-1d2631a0236b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1691 microversion: 2.1 time: 0.175127 Aug 24 14:45:46.676584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 365/763] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:46 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:46.699999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:46.700882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:46.710961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:46.711478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:46.711918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:46.713524 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:46.714039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:46.714460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:46.788961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:46.798234 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:46.799748 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:46.800879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e0b3e84c-767b-42af-938e-6ce5328cfbde tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1332 microversion: 2.20 time: 0.105743 Aug 24 14:45:46.801438 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 399/764] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:46 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:47.709638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:47.710302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:47.717544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:47.718061 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:47.718490 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:47.719193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:47.719760 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:47.720242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:47.826460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:47.827235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:47.834657 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:47.835158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:47.835597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:47.836316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:47.836803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:47.837356 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:47.867284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:47.876530 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2e1e0d09-4e3a-4ac2-875a-7aed49dd485c tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1691 microversion: 2.1 time: 0.170957 Aug 24 14:45:47.877137 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 366/765] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:47 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:47.916264 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:47.926182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:47.927768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:47.928917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8d3f30e8-eecb-44ac-8c3d-fbf6c736941d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1340 microversion: 2.20 time: 0.108804 Aug 24 14:45:47.929479 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 400/766] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:47 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1340 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:45:48.897939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:48.898544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:48.905508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:48.906043 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:48.906482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:48.907184 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:48.907628 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:48.908102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:48.954303 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:48.954884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:48.961454 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:48.962973 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:48.963414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:48.964114 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:48.964559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:48.964972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:49.044784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:49.064660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:49.067519 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:49.069534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-69d5348b-18e3-4665-93bc-e3d15b815242 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1340 microversion: 2.20 time: 0.119143 Aug 24 14:45:49.070609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 401/767] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:48 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1340 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:45:49.088968 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:49.097421 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f79072e1-813a-4db7-a7fc-da9d24e8abd5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1691 microversion: 2.1 time: 0.203501 Aug 24 14:45:49.098031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 367/768] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:48 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:50.093439 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:50.094137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:50.100943 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:50.101429 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:50.101898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:50.102662 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:50.103710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:50.104433 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:50.128662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:50.129312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:50.136993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:50.137415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:50.137888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:50.138597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:50.139093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:50.139480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:50.173798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:50.182689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:50.184119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:50.185234 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b182d451-a119-4712-85c3-1d3f2ff11ccb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1340 microversion: 2.20 time: 0.095951 Aug 24 14:45:50.185806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 402/769] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:50 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:50.283634 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:50.292135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4c23c6e8-a445-4675-80d1-5dd926ff5e5f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1691 microversion: 2.1 time: 0.167261 Aug 24 14:45:50.292720 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 368/770] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:50 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:51.209431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:51.210160 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:51.217882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:51.218375 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:51.218815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:51.220258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:51.220258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:51.220440 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:51.296952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:51.305383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:51.307231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:51.308337 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3beb3ac9-5823-4216-984a-f41fd7734219 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1340 microversion: 2.20 time: 0.102915 Aug 24 14:45:51.308892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 403/771] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:51 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:51.312593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:51.313195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:51.320131 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:51.320602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:51.321028 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:51.321837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:51.322280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:51.322694 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:51.479431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:51.488433 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bb7a7016-7614-4f15-a3b4-d2926ddfa536 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1691 microversion: 2.1 time: 0.179798 Aug 24 14:45:51.489247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 369/772] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:51 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:52.330878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:52.331488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:52.339501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:52.339995 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:52.340419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:52.341120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:52.341571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:52.342034 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:52.511408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:52.512574 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:52.518283 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:52.519158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:52.520342 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:52.520861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:52.521290 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:52.522120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:52.522562 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:52.530778 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:52.530995 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:52.530995 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:52.531578 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-239bcbb1-8946-4b3f-9148-f71501ed1a97 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.204777 Aug 24 14:45:52.532663 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 404/773] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:52 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:52.799210 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:52.808975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-271363d0-0471-4264-aeee-0cd9f1531929 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1691 microversion: 2.1 time: 0.302203 Aug 24 14:45:52.822492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 370/774] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:52 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1691 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:53.460387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-e4437e1c-8bd8-4486-9302-d7acae39c1e5 req-cc4f23a2-5b72-48a8-940b-0a893dc2dc2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a26d59-b1af-4dba-9aaf-bcd473a6b21e", "tag": "d04c4d4d-11af-427e-8e6f-526632a4a642"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:53.487120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e4437e1c-8bd8-4486-9302-d7acae39c1e5 req-cc4f23a2-5b72-48a8-940b-0a893dc2dc2a service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:53.487120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e4437e1c-8bd8-4486-9302-d7acae39c1e5 req-cc4f23a2-5b72-48a8-940b-0a893dc2dc2a service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:53.487120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e4437e1c-8bd8-4486-9302-d7acae39c1e5 req-cc4f23a2-5b72-48a8-940b-0a893dc2dc2a service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:53.500985 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-e4437e1c-8bd8-4486-9302-d7acae39c1e5 req-cc4f23a2-5b72-48a8-940b-0a893dc2dc2a service nova] Creating event network-changed:d04c4d4d-11af-427e-8e6f-526632a4a642 for instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e on hv-cinder-75671 Aug 24 14:45:53.506799 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-e4437e1c-8bd8-4486-9302-d7acae39c1e5 req-cc4f23a2-5b72-48a8-940b-0a893dc2dc2a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050898 Aug 24 14:45:53.510129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 405/775] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:53.555631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:53.556924 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:53.565201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:53.565846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:53.566275 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:53.566977 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:53.567419 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:53.567842 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:53.820487 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:53.831085 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:53.833148 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:53.833769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:53.833900 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:53.835617 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7610e7eb-d402-41d2-be0b-97a9a101ebc6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.284363 Aug 24 14:45:53.840950 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:53.842125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:53.842640 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:53.843424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:53.844117 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:53.844615 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:53.851173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 371/776] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:53 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:45:53.991903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:54.003965 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-db1143b3-e531-4d29-b6d8-2190b63e4499 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1623 microversion: 2.1 time: 0.174733 Aug 24 14:45:54.004830 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 406/777] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:53 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1623 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:54.121921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-a9b8614d-2742-4071-ba5a-f89c0d4a25e8 req-ca056308-e823-4798-b9e8-6ec401ef4187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d040cfc-ac45-4941-b04f-a8ba0f061929", "name": "network-vif-deleted", "tag": "8789513b-ca10-4941-a025-8a463c9cf8d1"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:45:54.135652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a9b8614d-2742-4071-ba5a-f89c0d4a25e8 req-ca056308-e823-4798-b9e8-6ec401ef4187 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:54.136607 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a9b8614d-2742-4071-ba5a-f89c0d4a25e8 req-ca056308-e823-4798-b9e8-6ec401ef4187 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:54.137281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-a9b8614d-2742-4071-ba5a-f89c0d4a25e8 req-ca056308-e823-4798-b9e8-6ec401ef4187 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:54.153295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-a9b8614d-2742-4071-ba5a-f89c0d4a25e8 req-ca056308-e823-4798-b9e8-6ec401ef4187 service nova] Creating event network-vif-deleted:8789513b-ca10-4941-a025-8a463c9cf8d1 for instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 on hv-cinder-75671 Aug 24 14:45:54.162969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-a9b8614d-2742-4071-ba5a-f89c0d4a25e8 req-ca056308-e823-4798-b9e8-6ec401ef4187 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048635 Aug 24 14:45:54.164201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 372/778] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:45:54.862476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:54.863708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:54.866162 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=6 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:54.871343 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:54.871837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:54.872279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:54.872994 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:54.873447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:54.873918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:55.022387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:55.023822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:55.024875 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:55.030147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:55.030896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:55.033701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:55.036130 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:55.037474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:55.037648 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e91cdd61-fee2-455f-80b7-0a91754f085c tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.178972 Aug 24 14:45:55.038349 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:55.038475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 407/779] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:54 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:55.039032 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:55.040133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:55.041368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:55.041368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:55.075343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:55.075817 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:55.076867 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:55.076867 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lazy-loading 'fault' on Instance uuid 3d040cfc-ac45-4941-b04f-a8ba0f061929 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:55.125814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:55.134456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9ac797a6-dc19-478e-b0c0-2ac079de4573 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1336 microversion: 2.1 time: 0.110936 Aug 24 14:45:55.135032 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 373/780] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:55 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:56.068300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:56.068866 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:56.072934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:45:56.078300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:56.078782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:56.079214 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:56.079915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:56.080367 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:56.080792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:56.160394 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:56.161081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:56.169189 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:56.169676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:56.181611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:56.181611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:56.181611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:56.181611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:56.205209 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:56.205926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:56.215844 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:56.215844 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lazy-loading 'fault' on Instance uuid 3d040cfc-ac45-4941-b04f-a8ba0f061929 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:56.264507 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:56.269587 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:56.276389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:56.278548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:56.279859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1f37c016-c667-4052-8cf4-cd955c8a193b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.216398 Aug 24 14:45:56.280021 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ef7614e0-62e3-459e-8b74-22a04a579ffd tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1336 microversion: 2.1 time: 0.123916 Aug 24 14:45:56.294109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 374/781] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:56 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1336 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:45:56.294563 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 408/782] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:56 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:45:57.301827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:57.302451 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:57.303868 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:57.304474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:57.309364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.309871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.310298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:57.310983 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.311190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.311428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.311733 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.311999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:57.312113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:57.312827 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.313262 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.313682 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:57.344352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:57.344828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:57.345265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:57.345730 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lazy-loading 'fault' on Instance uuid 3d040cfc-ac45-4941-b04f-a8ba0f061929 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:45:57.407418 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:57.415833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e6f6152e-fb39-42bf-858b-0667a7f8dc5e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 200 len: 1336 microversion: 2.1 time: 0.117236 Aug 24 14:45:57.416642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 375/783] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:57 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:45:57.470568 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:57.480241 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:57.481780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:57.482927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3d0d7763-8afd-4955-b8b9-1a0b96c808f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.183276 Aug 24 14:45:57.483485 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 409/784] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:57 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:45:58.437244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:58.437944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 3d040cfc-ac45-4941-b04f-a8ba0f061929] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:58.445226 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:58.445782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:58.446724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:58.447474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:58.447925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:58.448348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:58.462850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] HTTP exception thrown: Instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 could not be found. Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Request method failure captured: Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 HTTP/1.1 Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfTXgYsH_uCUJfw_RHTrVcfWZuvwl5MfL-ONV6ToM9lQxasvAVFAUkas_FvCvirtSAMuI4yIaYvO6wTcH9WvNJRfjugkcJ_JVI0X7snK4GuvM98h5M9_NaBJlX9UxIu4fYv1LxbWGv7hOPUKZuo5xm-IJXTi6uKEbvP_mkItHtXoFc Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:45:58.464631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}] Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 3acc0010e3f54283934b75f58bb6ec93 Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 could not be found. Aug 24 14:45:58.466546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '3d040cfc-ac45-4941-b04f-a8ba0f061929'} Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 could not be found. Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:45:58.467428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 could not be found. Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 could not be found. Aug 24 14:45:58.469009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:45:58.470242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Returning 404 to user: Instance 3d040cfc-ac45-4941-b04f-a8ba0f061929 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:45:58.470242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a28d6910-fff3-4073-9b55-1364258d7b2e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929" status: 404 len: 111 microversion: 2.1 time: 0.032928 Aug 24 14:45:58.470242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 376/785] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:45:58 2022] GET /compute/v2.1/servers/3d040cfc-ac45-4941-b04f-a8ba0f061929 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:45:58.477853 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-588ab20e-ea4e-45d1-bfde-7508557bcd06 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '.version_select at 0x7fbf7c201f70>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:58.507925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:58.509186 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:58.515738 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:58.516157 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:58.516589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:58.517298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:58.517772 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:58.518312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:58.597956 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-588ab20e-ea4e-45d1-bfde-7508557bcd06 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1243712867" status: 202 len: 0 microversion: 2.1 time: 0.126213 Aug 24 14:45:58.598864 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 410/786] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 24 14:45:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1243712867 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:45:58.721871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:58.734345 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:58.735867 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:58.741666 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-950b85a6-c70b-4559-a83a-fb20bb5358c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.235183 Aug 24 14:45:58.741666 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 377/787] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:58 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:45:59.765153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:45:59.765723 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:45:59.772345 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:59.772921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:59.773414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:59.774901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:45:59.775275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:45:59.775835 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:45:59.914250 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:59.923074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:59.924710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:45:59.925898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-982149e4-d079-4ba7-9471-97781454c5c6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.165453 Aug 24 14:45:59.926504 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 411/788] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:45:59 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:46:00.948088 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:00.948727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:00.955597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:00.956081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:00.956510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:00.957204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:00.957648 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:00.958102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:01.107987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:01.116459 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:01.118485 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:01.119613 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-03a0040c-d118-4ac3-8b95-7220d4d3ee1f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.175536 Aug 24 14:46:01.120234 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 378/789] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:00 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:46:02.144236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:02.144850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:02.152447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.152933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.153373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:02.154119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:02.154572 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:02.154994 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:02.319276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:02.328174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:02.330004 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:02.331132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-01ca2f6e-4565-42a5-ae8c-730ca9b3b286 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.191048 Aug 24 14:46:02.331760 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 412/790] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:02 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:03.355587 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:03.356148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:03.363004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:03.363534 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:03.364047 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:03.364754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:03.365204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:03.365629 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:03.506491 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:03.515841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:03.517339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:03.518482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39eccb55-78ea-4359-9374-1031fe57ea88 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.167870 Aug 24 14:46:03.519055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 379/791] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:03 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:04.112275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-fe31a017-2f86-4dbc-b9b1-e638b0463737 req-3ce937f5-c0aa-49bb-89c5-d6d79cd71b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a26d59-b1af-4dba-9aaf-bcd473a6b21e", "name": "network-vif-plugged", "status": "completed", "tag": "d04c4d4d-11af-427e-8e6f-526632a4a642"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:04.131704 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-fe31a017-2f86-4dbc-b9b1-e638b0463737 req-3ce937f5-c0aa-49bb-89c5-d6d79cd71b51 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:04.132112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-fe31a017-2f86-4dbc-b9b1-e638b0463737 req-3ce937f5-c0aa-49bb-89c5-d6d79cd71b51 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:04.132543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-fe31a017-2f86-4dbc-b9b1-e638b0463737 req-3ce937f5-c0aa-49bb-89c5-d6d79cd71b51 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:04.145854 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-fe31a017-2f86-4dbc-b9b1-e638b0463737 req-3ce937f5-c0aa-49bb-89c5-d6d79cd71b51 service nova] Creating event network-vif-plugged:d04c4d4d-11af-427e-8e6f-526632a4a642 for instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e on hv-cinder-75671 Aug 24 14:46:04.153004 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-fe31a017-2f86-4dbc-b9b1-e638b0463737 req-3ce937f5-c0aa-49bb-89c5-d6d79cd71b51 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045744 Aug 24 14:46:04.153736 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 413/792] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:04.553667 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:04.558143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:04.568119 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:04.569733 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:04.571043 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:04.572592 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:04.573409 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:04.574432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:04.771295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:04.783846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:04.786124 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:04.789055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c624c14-668b-4697-9f59-61b40da5759e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.242978 Aug 24 14:46:04.790590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 380/793] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:04 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:05.813412 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:05.814118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:05.820117 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.820596 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.821776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:05.822752 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:05.823214 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:05.823638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:05.965871 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:05.968214 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:05.975219 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:05.981445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:05.981445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d0363808-2daf-4ae1-9ab7-851095241e09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1405 microversion: 2.20 time: 0.169035 Aug 24 14:46:05.981445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 414/794] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:05 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:06.559718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:06.559718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:06.564069 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:06.564553 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:06.565054 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:06.565836 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:06.566295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:06.566711 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:06.594856 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:46:06.627640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:06.945295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cc03687f-8eb3-4694-b79b-5d9d1ac30740 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 204 len: 0 microversion: 2.1 time: 0.391943 Aug 24 14:46:06.946742 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 381/795] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:46:06 2022] DELETE /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:46:06.955490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:06.956327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:06.964198 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:06.965074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:06.965832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:06.966941 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:06.967712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:06.968448 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.003947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:07.004884 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:07.025572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.026189 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.026728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.027539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.028130 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.028637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.202313 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:07.214512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a5d61d60-2aa3-4820-aeea-d59e7601230e tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1509 microversion: 2.1 time: 0.263129 Aug 24 14:46:07.221956 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 415/796] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:06 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:07.242383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:07.257775 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:07.261231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:07.263357 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9de9cf1d-1a52-464b-8a90-149078b4f2a9 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1597 microversion: 2.20 time: 0.264984 Aug 24 14:46:07.264387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 382/797] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:46:06 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1597 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:46:07.300606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:07.300994 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:07.307918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.308385 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.308824 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.309550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:07.310012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:07.310441 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:07.414281 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-39b86182-2c55-48e3-89a2-dc7e7b459125 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117653 Aug 24 14:46:07.415628 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 416/798] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 24 14:46:07 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:46:08.243112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:08.243932 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:08.250780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:08.251256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:08.251759 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:08.252446 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:08.252894 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:08.253310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:08.760027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:08.768094 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f2206ff7-fe72-4b3b-b57e-b9115d248899 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1509 microversion: 2.1 time: 0.528958 Aug 24 14:46:08.768920 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 383/799] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:08 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:09.006594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-2139aa5e-ce7e-481a-973b-36225d469079 req-aa6b3e5d-ff0e-4a24-9622-98f778af2726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a26d59-b1af-4dba-9aaf-bcd473a6b21e", "tag": "d04c4d4d-11af-427e-8e6f-526632a4a642"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:09.025171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2139aa5e-ce7e-481a-973b-36225d469079 req-aa6b3e5d-ff0e-4a24-9622-98f778af2726 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:09.026069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2139aa5e-ce7e-481a-973b-36225d469079 req-aa6b3e5d-ff0e-4a24-9622-98f778af2726 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:09.026618 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2139aa5e-ce7e-481a-973b-36225d469079 req-aa6b3e5d-ff0e-4a24-9622-98f778af2726 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.045686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-2139aa5e-ce7e-481a-973b-36225d469079 req-aa6b3e5d-ff0e-4a24-9622-98f778af2726 service nova] Creating event network-changed:d04c4d4d-11af-427e-8e6f-526632a4a642 for instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e on hv-cinder-75671 Aug 24 14:46:09.055603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-2139aa5e-ce7e-481a-973b-36225d469079 req-aa6b3e5d-ff0e-4a24-9622-98f778af2726 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052320 Aug 24 14:46:09.057919 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 417/800] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:09.340947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-e3616da9-0441-46e2-9d09-7cac00d591af req-e6f5a2aa-619c-4cd0-b1ae-95898781dd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c66552-d72b-47db-b7ae-2d2fe02ef11a", "name": "network-vif-deleted", "tag": "8b158e3e-7307-4f1b-b356-8819d9bf1e42"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:09.355827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e3616da9-0441-46e2-9d09-7cac00d591af req-e6f5a2aa-619c-4cd0-b1ae-95898781dd29 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:09.356736 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e3616da9-0441-46e2-9d09-7cac00d591af req-e6f5a2aa-619c-4cd0-b1ae-95898781dd29 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:09.357340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-e3616da9-0441-46e2-9d09-7cac00d591af req-e6f5a2aa-619c-4cd0-b1ae-95898781dd29 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.370908 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-e3616da9-0441-46e2-9d09-7cac00d591af req-e6f5a2aa-619c-4cd0-b1ae-95898781dd29 service nova] Creating event network-vif-deleted:8b158e3e-7307-4f1b-b356-8819d9bf1e42 for instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a on hv-cinder-75671 Aug 24 14:46:09.376585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-e3616da9-0441-46e2-9d09-7cac00d591af req-e6f5a2aa-619c-4cd0-b1ae-95898781dd29 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040030 Aug 24 14:46:09.377508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 384/801] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:09.791187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:09.792474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:09.805360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:09.805360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:09.805360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.805360 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:09.805903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:09.805903 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:09.899789 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:09.910746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-489b1a69-9ff0-4b9b-9421-cae130bfd27b tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 200 len: 1293 microversion: 2.1 time: 0.124218 Aug 24 14:46:09.911934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 418/802] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:09 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:10.945712 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:10.946721 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: f9c66552-d72b-47db-b7ae-2d2fe02ef11a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:10.953301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.954009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.954636 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.955451 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.956003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.956520 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.971947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] HTTP exception thrown: Instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a could not be found. Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Request method failure captured: Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a HTTP/1.1 Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfTXgYsH_uCUJfw_RHTrVcfWZuvwl5MfL-ONV6ToM9lQxasvAVFAUkas_FvCvirtSAMuI4yIaYvO6wTcH9WvNJRfjugkcJ_JVI0X7snK4GuvM98h5M9_NaBJlX9UxIu4fYv1LxbWGv7hOPUKZuo5xm-IJXTi6uKEbvP_mkItHtXoFc Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:46:10.973624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}] Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 3acc0010e3f54283934b75f58bb6ec93 Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a could not be found. Aug 24 14:46:10.976682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'f9c66552-d72b-47db-b7ae-2d2fe02ef11a'} Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a could not be found. Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:46:10.979305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a could not be found. Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a could not be found. Aug 24 14:46:10.981388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:10.982903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Returning 404 to user: Instance f9c66552-d72b-47db-b7ae-2d2fe02ef11a could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:46:10.982903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0708137a-499c-4a46-b52c-ae4b570303f5 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a" status: 404 len: 111 microversion: 2.1 time: 0.034124 Aug 24 14:46:10.982903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 385/803] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:10 2022] GET /compute/v2.1/servers/f9c66552-d72b-47db-b7ae-2d2fe02ef11a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:46:10.987460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:10.990275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:10.995342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.995829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.996263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:10.996955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:10.997437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:10.997881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:11.033896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:46:11.402591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a1fecc07-b680-4c38-8105-f84929dffa71 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "DELETE /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 204 len: 0 microversion: 2.1 time: 0.419599 Aug 24 14:46:11.403265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 419/804] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:46:10 2022] DELETE /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:46:11.412125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:11.412740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:11.419081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:11.419561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:11.420005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:11.420686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:11.421136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:11.421555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:11.575585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:11.587294 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a70f51a5-396f-4e2d-b674-d060e8e5bc0f tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.178762 Aug 24 14:46:11.588283 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 386/805] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:11 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:12.611583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:12.612270 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:12.619674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.620158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.620656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:12.621393 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:12.621874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:12.622299 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:12.848289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:12.864534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-45a3ba2f-0179-42c6-b203-02aa2feba122 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1521 microversion: 2.1 time: 0.253804 Aug 24 14:46:12.865495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 420/806] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:12 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:13.387401 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-4f948b9d-3ee3-450b-96c7-ed795202acc7 req-9d25164a-b027-435d-b7ef-f003ebb6d469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279f90bd-61da-416d-9bd8-de6da5bd41ce", "name": "network-vif-deleted", "tag": "0a890f22-afe5-4a9a-a3b8-506e89f9fe19"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:13.404261 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4f948b9d-3ee3-450b-96c7-ed795202acc7 req-9d25164a-b027-435d-b7ef-f003ebb6d469 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:13.404945 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4f948b9d-3ee3-450b-96c7-ed795202acc7 req-9d25164a-b027-435d-b7ef-f003ebb6d469 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:13.405643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-4f948b9d-3ee3-450b-96c7-ed795202acc7 req-9d25164a-b027-435d-b7ef-f003ebb6d469 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:13.425614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-4f948b9d-3ee3-450b-96c7-ed795202acc7 req-9d25164a-b027-435d-b7ef-f003ebb6d469 service nova] Creating event network-vif-deleted:0a890f22-afe5-4a9a-a3b8-506e89f9fe19 for instance 279f90bd-61da-416d-9bd8-de6da5bd41ce on hv-cinder-75671 Aug 24 14:46:13.434943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-4f948b9d-3ee3-450b-96c7-ed795202acc7 req-9d25164a-b027-435d-b7ef-f003ebb6d469 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050977 Aug 24 14:46:13.436000 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 387/807] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:13.901011 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:13.901699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:13.909676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:13.910727 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:13.911242 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:13.911987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:13.912450 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:13.912889 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:13.949603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:13.950029 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:13.950461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:13.950906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lazy-loading 'fault' on Instance uuid 279f90bd-61da-416d-9bd8-de6da5bd41ce {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:46:13.996411 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acc0010e3f54283934b75f58bb6ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5abfb715e14ddf84e0b4519a3d724b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:14.004166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-32314368-3f3d-4f28-8611-e6e8f6c8de49 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 200 len: 1311 microversion: 2.1 time: 0.108525 Aug 24 14:46:14.006205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 421/808] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:13 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:15.027335 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:15.027905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] [instance: 279f90bd-61da-416d-9bd8-de6da5bd41ce] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:15.034426 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:15.034898 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:15.035326 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:15.036007 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:15.036451 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:15.036869 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:15.051635 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] HTTP exception thrown: Instance 279f90bd-61da-416d-9bd8-de6da5bd41ce could not be found. Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Request method failure captured: Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce HTTP/1.1 Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfTXgYsH_uCUJfw_RHTrVcfWZuvwl5MfL-ONV6ToM9lQxasvAVFAUkas_FvCvirtSAMuI4yIaYvO6wTcH9WvNJRfjugkcJ_JVI0X7snK4GuvM98h5M9_NaBJlX9UxIu4fYv1LxbWGv7hOPUKZuo5xm-IJXTi6uKEbvP_mkItHtXoFc Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:46:15.053323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6c5abfb715e14ddf84e0b4519a3d724b"}]}] Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 6c5abfb715e14ddf84e0b4519a3d724b Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-225664549 Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 3acc0010e3f54283934b75f58bb6ec93 Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-225664549-project Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 279f90bd-61da-416d-9bd8-de6da5bd41ce could not be found. Aug 24 14:46:15.056614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '279f90bd-61da-416d-9bd8-de6da5bd41ce'} Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279f90bd-61da-416d-9bd8-de6da5bd41ce could not be found. Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:46:15.058387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279f90bd-61da-416d-9bd8-de6da5bd41ce could not be found. Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279f90bd-61da-416d-9bd8-de6da5bd41ce could not be found. Aug 24 14:46:15.061009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:15.064091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] Returning 404 to user: Instance 279f90bd-61da-416d-9bd8-de6da5bd41ce could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:46:15.064091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a54a631-c461-4056-ae2c-e305491c6b11 tempest-ServerRescueNegativeTestJSON-225664549 tempest-ServerRescueNegativeTestJSON-225664549-project] 10.222.0.65 "GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce" status: 404 len: 111 microversion: 2.1 time: 0.032333 Aug 24 14:46:15.064091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 388/809] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:15 2022] GET /compute/v2.1/servers/279f90bd-61da-416d-9bd8-de6da5bd41ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:46:16.399645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:16.402036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:16.409146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:16.409947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:16.410350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:16.411131 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:16.411781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:16.412209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:16.457210 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1067c4b2-7098-4345-8888-6c9d583cd588 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062798 Aug 24 14:46:16.458455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 422/810] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:46:16 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:46:16.550019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:16.550884 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:16.562763 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:16.563514 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:16.563969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:16.564938 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:16.565405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:16.565891 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:16.605397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:46:16.950447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-477e73bd-a9c7-4cac-9e08-1043b2d1c43d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 204 len: 0 microversion: 2.1 time: 0.404154 Aug 24 14:46:16.951420 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 389/811] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:46:16 2022] DELETE /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:46:16.964428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:16.965565 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:16.974488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:16.975124 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:16.975669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:16.978248 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:16.978248 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:16.978248 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:17.246364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:17.258243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-aeaf70eb-cbe1-4efc-82cf-402702c6d56b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1673 microversion: 2.1 time: 0.300896 Aug 24 14:46:17.259791 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 423/812] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:16 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1673 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:18.288449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:18.291862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:18.307232 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:18.309974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:18.319115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:18.319115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:18.319115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:18.319115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:18.853947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:18.871003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-094ab953-f991-477a-9e98-e4419fa5e5a9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1673 microversion: 2.1 time: 0.593571 Aug 24 14:46:18.871975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 390/813] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:18 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1673 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:19.897607 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:19.901216 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:19.927224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:19.927936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:19.928584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:19.929624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:19.930308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:19.931093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:20.152769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:20.171649 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e02803ff-1673-4809-afce-53f370d04244 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1605 microversion: 2.1 time: 0.280061 Aug 24 14:46:20.183931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 424/814] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:19 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:20.185112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-117c53f3-9fa0-46c3-936e-a8f9f4e1fd7f req-80654cd8-7546-493f-9b68-a77eb2ae6b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aef7e3a-316c-4347-ae40-5370582a017b", "name": "network-vif-deleted", "tag": "40420387-41a5-4e65-b209-88e109f9d32e"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:20.201826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-117c53f3-9fa0-46c3-936e-a8f9f4e1fd7f req-80654cd8-7546-493f-9b68-a77eb2ae6b58 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:20.207198 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-117c53f3-9fa0-46c3-936e-a8f9f4e1fd7f req-80654cd8-7546-493f-9b68-a77eb2ae6b58 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:20.209815 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-117c53f3-9fa0-46c3-936e-a8f9f4e1fd7f req-80654cd8-7546-493f-9b68-a77eb2ae6b58 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:20.234413 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-117c53f3-9fa0-46c3-936e-a8f9f4e1fd7f req-80654cd8-7546-493f-9b68-a77eb2ae6b58 service nova] Creating event network-vif-deleted:40420387-41a5-4e65-b209-88e109f9d32e for instance 5aef7e3a-316c-4347-ae40-5370582a017b on hv-cinder-75671 Aug 24 14:46:20.249095 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-117c53f3-9fa0-46c3-936e-a8f9f4e1fd7f req-80654cd8-7546-493f-9b68-a77eb2ae6b58 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069386 Aug 24 14:46:20.250609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 391/815] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:21.208048 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:21.209532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:21.234089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:21.234569 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:21.235126 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:21.236103 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:21.236639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:21.237734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:21.301835 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:21.302336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:21.302818 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:21.303461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lazy-loading 'fault' on Instance uuid 5aef7e3a-316c-4347-ae40-5370582a017b {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:46:21.381411 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:21.404498 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4ae8420f-e631-4d5a-b9b6-55c246a2dfd4 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 200 len: 1327 microversion: 2.1 time: 0.202450 Aug 24 14:46:21.410584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 425/816] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:21 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 1327 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:22.445681 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:22.446555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:22.453641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:22.454236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:22.454677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:22.455383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:22.455835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:22.456254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:22.474168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] HTTP exception thrown: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Request method failure captured: Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b HTTP/1.1 Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfTMTqeki7e1EmF8wpCXJEdeaHADumea9K7qtYIPe0YpLrwznCDwUeCElR8Zm6IihU5oxrYoJ2yIDhQDem6j7tuRhAagsfggjPzNWkWYvHdZpZT0X1aNv7iNxCGn2eJFoQLg1eAo2AwoE0EpFfSY6QBA3guaVJYMvfpTOsNK3wUKrQ Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:46:22.475834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}] Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 556b3a886df740cda4a94e55d2fcc08a Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:46:22.478757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '5aef7e3a-316c-4347-ae40-5370582a017b'} Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:46:22.480299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:46:22.481838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:46:22.483112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Returning 404 to user: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:46:22.483112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-02d90c1f-5126-45af-98b0-5381ee5eb650 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 404 len: 111 microversion: 2.1 time: 0.036598 Aug 24 14:46:22.483112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 392/817] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:22 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:46:22.488284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-59449a02-befb-40aa-b0a5-6490b084bea9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '.version_select at 0x7fbf7836d9d0>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:22.610393 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-59449a02-befb-40aa-b0a5-6490b084bea9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778787705" status: 202 len: 0 microversion: 2.1 time: 0.125576 Aug 24 14:46:22.611727 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 426/818] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 24 14:46:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778787705 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:46:23.754090 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d703d538-2398-4c13-9281-7ac66e403129 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'create', calling method: .version_select at 0x7fbf786fbd30>, body: {"keypair": {"name": "tempest-keypair-455678448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmDD3JatQ6LVzPZvaoLSC3PhwRZ9YNG8G7VMNcxYoCAKPi+UmBzuOPEm80cIGCDdt44dkvu/2RvQx/4S6Y3CdKI3WGXXE7vb4LvdrqEh89FYwYL43uVg5Drnc0lOHrYOQ=="}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:23.772237 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:23.783669 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-d703d538-2398-4c13-9281-7ac66e403129 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Getting quotas for project 2395c1dafb6a4174a7dd095c4809c181. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:23.788325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-d703d538-2398-4c13-9281-7ac66e403129 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Getting quotas for user 556b3a886df740cda4a94e55d2fcc08a and project 2395c1dafb6a4174a7dd095c4809c181. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:23.948680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d703d538-2398-4c13-9281-7ac66e403129 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.198164 Aug 24 14:46:23.950847 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 393/819] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:46:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:29.098458 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1970660141", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d711b7b4-bb60-42ae-97dc-7788e7f576aa"}], "security_groups": [{"name": "tempest-securitygroup--1324279478"}], "key_name": "tempest-keypair-455678448", "user_data": "}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:29.132044 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:29.319158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] validate_networks() for [('d711b7b4-bb60-42ae-97dc-7788e7f576aa', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:46:30.239867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:46:30.239867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:46:30.239867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:46:30.239867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:46:30.239867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:46:30.302698 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:30.303521 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:30.304218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:30.315170 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:30.316950 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:30.317400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:30.388039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Getting quotas for project 2395c1dafb6a4174a7dd095c4809c181. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:30.412157 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Getting quotas for user 556b3a886df740cda4a94e55d2fcc08a and project 2395c1dafb6a4174a7dd095c4809c181. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:30.455954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:46:30.469572 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:46:30.703996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-10a94971-773e-40c4-95f7-ed4287890a5e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.619905 Aug 24 14:46:30.704643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 427/820] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:46:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:46:30.720484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-165fec77-dd8a-4b3f-a850-35bc6af80d9e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:30.721707 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-165fec77-dd8a-4b3f-a850-35bc6af80d9e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:30.894958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-165fec77-dd8a-4b3f-a850-35bc6af80d9e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:30.904022 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-165fec77-dd8a-4b3f-a850-35bc6af80d9e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1237 microversion: 2.1 time: 0.188657 Aug 24 14:46:30.904598 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 394/821] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:30 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1237 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:31.946191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7651905a-78f0-4e35-b697-0fd26158b1f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:31.948643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7651905a-78f0-4e35-b697-0fd26158b1f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:32.168796 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7651905a-78f0-4e35-b697-0fd26158b1f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:32.184307 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7651905a-78f0-4e35-b697-0fd26158b1f9 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1237 microversion: 2.1 time: 0.256235 Aug 24 14:46:32.185887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 428/822] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:31 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1237 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:33.203766 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:33.216572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:33.217190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:33.227340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:33.232039 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:33.233268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:33.234292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:33.235325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:33.236284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:33.349790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:33.361828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-35b64c65-d6ef-42be-b18a-394c4f527b0b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1233 microversion: 2.1 time: 0.159123 Aug 24 14:46:33.363038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 395/823] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:33 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1233 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:34.216859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-07fa0724-a006-4d44-a473-76bce1f97536 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: .version_select at 0x7fbf7c2e34c0>, body: {"keypair": {"name": "tempest-keypair-1203959852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWZdcZx1rtGk+Uy8UwSchqUBpELu2D84mcm7LFHOoD1jiCmaat+V9g96GfJDgMP6XNtxUA1WIRV/pcklKl1YTTeGGleLWr7efGY50r99A/OuQ1w2WmNzSy7jY2pLrc4uQ=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:34.254288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-07fa0724-a006-4d44-a473-76bce1f97536 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for project 13d426499b5b40818dca1573cb839b16. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:34.262076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-07fa0724-a006-4d44-a473-76bce1f97536 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for user f88f7857e1d24bb0b038b7f6e98a6f34 and project 13d426499b5b40818dca1573cb839b16. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:34.387741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:34.389080 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:34.397497 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:34.399366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:34.400612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:34.402323 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:34.402928 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:34.403597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:34.474952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-07fa0724-a006-4d44-a473-76bce1f97536 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.541711 Aug 24 14:46:34.498813 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 429/824] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:46:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:34.512144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:34.524375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4d60379f-4829-49e7-9d2c-761f89051a20 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1297 microversion: 2.1 time: 0.143125 Aug 24 14:46:34.525628 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 396/825] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:34 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:35.557933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:35.559243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:35.572626 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:35.573433 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:35.574087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:35.575025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:35.575656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:35.576252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:35.755268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:35.774708 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9d3ad615-a303-4bce-847a-6eda337b52ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1295 microversion: 2.1 time: 0.227094 Aug 24 14:46:35.775308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 430/826] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:35 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1295 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:36.813812 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:36.814882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:36.854531 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:36.855285 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:36.855939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:36.856730 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:36.870886 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:36.871343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:37.470918 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:37.485970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a56a02d5-ec53-43c3-a00e-3a993366b11e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.677691 Aug 24 14:46:37.487159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 397/827] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:36 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:38.526387 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:38.527966 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:38.555438 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:38.563408 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:38.567882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:38.574511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:38.575475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:38.576180 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:38.595158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:39.108394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:39.135036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-09b29a9b-2c62-4a48-b81c-264a92d736ab tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.612153 Aug 24 14:46:39.136762 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 431/828] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:38 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:39.298594 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-2c2900ea-e0f5-4c18-9d95-7ae0f67c0678 req-2bd251f4-4228-4e69-95ef-d286ed51c5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1843548-9be2-41a0-a8a7-1f7897083355", "tag": "189b0de6-d6db-428a-a91a-189294ec2553"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:39.359057 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1893459293", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72239629-4056-40ff-9127-a5a5ca07ba84"}], "security_groups": [{"name": "tempest-securitygroup--107930642"}], "key_name": "tempest-keypair-1203959852", "user_data": "}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:39.360485 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-2c2900ea-e0f5-4c18-9d95-7ae0f67c0678 req-2bd251f4-4228-4e69-95ef-d286ed51c5e4 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:39.361337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-2c2900ea-e0f5-4c18-9d95-7ae0f67c0678 req-2bd251f4-4228-4e69-95ef-d286ed51c5e4 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:39.362045 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-2c2900ea-e0f5-4c18-9d95-7ae0f67c0678 req-2bd251f4-4228-4e69-95ef-d286ed51c5e4 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:39.418996 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-2c2900ea-e0f5-4c18-9d95-7ae0f67c0678 req-2bd251f4-4228-4e69-95ef-d286ed51c5e4 service nova] Creating event network-changed:189b0de6-d6db-428a-a91a-189294ec2553 for instance a1843548-9be2-41a0-a8a7-1f7897083355 on hv-cinder-75671 Aug 24 14:46:39.438547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-2c2900ea-e0f5-4c18-9d95-7ae0f67c0678 req-2bd251f4-4228-4e69-95ef-d286ed51c5e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148631 Aug 24 14:46:39.449997 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 398/829] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:39.767131 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] validate_networks() for [('72239629-4056-40ff-9127-a5a5ca07ba84', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:46:40.181720 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:40.182960 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:40.198344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:40.202782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:40.203542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:40.205895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:40.206623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:40.207262 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:40.355223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:40.904826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:41.015703 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:41.027382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-65080cc8-d11d-4b8d-9b88-696f479e7cd3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.859046 Aug 24 14:46:41.029035 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 399/830] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:40 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:41.281305 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:46:41.282724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:46:41.283531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:46:41.284158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:46:41.284742 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:46:41.298630 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:41.299373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:41.303735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:41.303735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:41.303735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:41.303735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:41.331453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for project 13d426499b5b40818dca1573cb839b16. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:41.337293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for user f88f7857e1d24bb0b038b7f6e98a6f34 and project 13d426499b5b40818dca1573cb839b16. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:41.352012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:46:41.354922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:46:41.510496 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-08bcb6de-ee05-4211-9a82-b80eab7aa832 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.161323 Aug 24 14:46:41.511558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 432/831] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:46:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:46:41.525015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cb5ef2b6-53f5-419a-8165-41d7a33d5c99 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:41.525810 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cb5ef2b6-53f5-419a-8165-41d7a33d5c99 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:41.677735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb5ef2b6-53f5-419a-8165-41d7a33d5c99 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:41.688088 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cb5ef2b6-53f5-419a-8165-41d7a33d5c99 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1242 microversion: 2.1 time: 0.168662 Aug 24 14:46:41.689079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 400/832] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:41 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1242 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:42.060309 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:42.061042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:42.068477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:42.069290 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:42.069951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:42.074271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:42.074271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:42.074271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:42.258609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:42.271845 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-02eeba1a-1580-4f06-9826-a04ed26f37da tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.213354 Aug 24 14:46:42.273543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 433/833] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:42 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:42.720743 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-40148b32-1079-472f-be96-cdcdd83fe7a4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:42.721980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-40148b32-1079-472f-be96-cdcdd83fe7a4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:42.833434 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-40148b32-1079-472f-be96-cdcdd83fe7a4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:42.845389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-40148b32-1079-472f-be96-cdcdd83fe7a4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1242 microversion: 2.1 time: 0.131031 Aug 24 14:46:42.846799 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 401/834] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:42 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:43.297004 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:43.297725 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:43.315108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:43.315608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:43.316078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:43.316985 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:43.317461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:43.328169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:43.520734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:43.540288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-22615dd1-1fc8-49ad-92ef-51d0174c99e3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.249879 Aug 24 14:46:43.540993 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 434/835] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:43 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:43.875888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:43.878186 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:43.888619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:43.889488 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:43.890178 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:43.891072 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:43.892326 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:43.893441 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:43.979205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:43.988883 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f9e31654-5a1f-4f0d-8c7b-800da1385827 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1246 microversion: 2.1 time: 0.121895 Aug 24 14:46:44.002719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 402/836] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:43 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:44.570428 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:44.571347 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:44.581790 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:44.588759 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:44.590887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:44.590887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:44.591613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:44.592272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:44.808908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:44.823716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-216614b1-b008-4098-99c1-b6d4c7d5d6b7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.250943 Aug 24 14:46:44.823716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 435/837] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:44 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:45.013606 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:45.014274 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:45.020769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:45.021244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:45.021903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:45.023509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:45.024202 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:45.024786 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:45.137806 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:45.157866 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-adadbbd2-b9d9-4283-b1c4-1a0c5553a3b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1294 microversion: 2.1 time: 0.148602 Aug 24 14:46:45.162894 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 403/838] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:45 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1294 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:45.839181 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:45.840453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:45.857537 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:45.862775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:45.865837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:45.865837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:45.865837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:45.865837 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:46.155150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:46.188368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:46.189279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:46.190221 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4a6ed300-8b3e-4f36-862f-47e8cf924b13 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.355889 Aug 24 14:46:46.191120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 436/839] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:45 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:46.218143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:46.226975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:46.228166 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:46.229698 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:46.230366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:46.231858 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:46.453216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:46.469543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c338004-bb69-426a-99b4-526fe0cc5b98 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1300 microversion: 2.1 time: 0.287261 Aug 24 14:46:46.472584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 404/840] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:46 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1300 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:46.635034 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-2e84553d-f45c-4127-98f6-bb6dae63cc04 req-0bddd372-45c4-4d09-94e1-002577be1865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1843548-9be2-41a0-a8a7-1f7897083355", "name": "network-vif-plugged", "status": "completed", "tag": "189b0de6-d6db-428a-a91a-189294ec2553"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:46.647466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2e84553d-f45c-4127-98f6-bb6dae63cc04 req-0bddd372-45c4-4d09-94e1-002577be1865 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:46.654161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2e84553d-f45c-4127-98f6-bb6dae63cc04 req-0bddd372-45c4-4d09-94e1-002577be1865 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:46.655020 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2e84553d-f45c-4127-98f6-bb6dae63cc04 req-0bddd372-45c4-4d09-94e1-002577be1865 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:46.684145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-2e84553d-f45c-4127-98f6-bb6dae63cc04 req-0bddd372-45c4-4d09-94e1-002577be1865 service nova] Creating event network-vif-plugged:189b0de6-d6db-428a-a91a-189294ec2553 for instance a1843548-9be2-41a0-a8a7-1f7897083355 on hv-cinder-75671 Aug 24 14:46:46.691985 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-2e84553d-f45c-4127-98f6-bb6dae63cc04 req-0bddd372-45c4-4d09-94e1-002577be1865 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061072 Aug 24 14:46:46.693351 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 437/841] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:47.218034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:47.229440 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:47.254312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.267329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.273970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.273970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.273970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.273970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.511964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:47.513502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:47.536512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.537483 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.539351 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.543333 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:47.543827 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:47.544271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:47.749879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:47.766281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1b2f7112-9c29-4e06-bbd3-608e251f95ee tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.547250 Aug 24 14:46:47.767321 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 405/842] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:47 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:48.009287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:48.022763 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-038aa047-e0db-40c8-a1a8-9e39ea7c55b5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.517075 Aug 24 14:46:48.026516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 438/843] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:47 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:48.794997 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:48.795874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:48.802990 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:48.803483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:48.803962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:48.807034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:48.807034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:48.807034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:48.844869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-176eb43d-109a-4180-91c5-3738711fe695 req-8054598f-138f-4841-8cc7-1a6db572851b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e58813-5807-452b-ae56-f0aeeb215ac9", "tag": "21285ac6-45a9-46f0-94fd-debd0b98b3ba"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:48.886220 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-176eb43d-109a-4180-91c5-3738711fe695 req-8054598f-138f-4841-8cc7-1a6db572851b service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:48.900491 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-176eb43d-109a-4180-91c5-3738711fe695 req-8054598f-138f-4841-8cc7-1a6db572851b service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:48.901905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-176eb43d-109a-4180-91c5-3738711fe695 req-8054598f-138f-4841-8cc7-1a6db572851b service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:48.930155 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-176eb43d-109a-4180-91c5-3738711fe695 req-8054598f-138f-4841-8cc7-1a6db572851b service nova] Creating event network-changed:21285ac6-45a9-46f0-94fd-debd0b98b3ba for instance a4e58813-5807-452b-ae56-f0aeeb215ac9 on hv-cinder-75671 Aug 24 14:46:48.939581 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-176eb43d-109a-4180-91c5-3738711fe695 req-8054598f-138f-4841-8cc7-1a6db572851b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124060 Aug 24 14:46:48.940194 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 439/844] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:49.048306 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:49.049203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:49.053616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:49.057265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:49.058353 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:49.058850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:49.059929 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:49.060734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:49.061485 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:49.066726 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bdd9c2bf-9ac8-4e36-88c5-01e34b905490 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1363 microversion: 2.1 time: 0.281527 Aug 24 14:46:49.067532 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 406/845] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:48 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:49.238665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:49.247261 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b24f2b74-897e-45a9-bbe4-6da3838ab8e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.203666 Aug 24 14:46:49.247834 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 440/846] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:49 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:50.090115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:50.091442 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:50.103163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:50.104011 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:50.104649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:50.105584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:50.106302 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:50.107636 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:50.273022 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:50.274577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:50.290273 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:50.293284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:50.294010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:50.294971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:50.295829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:50.299648 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:50.337888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:50.351735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a98b5144-581d-4170-ac5e-4d48e672e73b tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1550 microversion: 2.1 time: 0.266145 Aug 24 14:46:50.353229 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 407/847] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:50 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1550 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:50.393849 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:50.395044 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:50.415285 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:50.415774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:50.418535 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:50.419680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:50.420350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:50.420922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:50.587793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-85cd8dc6-93c0-4d33-893a-07dad0d20b00 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207221 Aug 24 14:46:50.589223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 408/848] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 14:46:50 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:50.629560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:50.640402 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8996224f-9723-4fee-bd11-088bba7a6772 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.374118 Aug 24 14:46:50.641774 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 441/849] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:50 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:51.664698 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:51.666092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:51.673398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:51.673996 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:51.674684 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:51.675593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:51.676261 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:51.676749 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:51.912333 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:51.922274 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fb0fad99-d8ac-4fcd-acca-a9343c3699ed tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.262659 Aug 24 14:46:51.937492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 409/850] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:51 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:52.019445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:52.020226 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=18 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:52.024758 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-a2728fd1-9a9f-4370-9d21-68674d48752d req-4feb3844-8d4a-4664-a20f-367cf11b600f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1843548-9be2-41a0-a8a7-1f7897083355", "tag": "189b0de6-d6db-428a-a91a-189294ec2553"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:52.036940 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a2728fd1-9a9f-4370-9d21-68674d48752d req-4feb3844-8d4a-4664-a20f-367cf11b600f service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:52.037832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a2728fd1-9a9f-4370-9d21-68674d48752d req-4feb3844-8d4a-4664-a20f-367cf11b600f service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:52.038840 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a2728fd1-9a9f-4370-9d21-68674d48752d req-4feb3844-8d4a-4664-a20f-367cf11b600f service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:52.061379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-a2728fd1-9a9f-4370-9d21-68674d48752d req-4feb3844-8d4a-4664-a20f-367cf11b600f service nova] Creating event network-changed:189b0de6-d6db-428a-a91a-189294ec2553 for instance a1843548-9be2-41a0-a8a7-1f7897083355 on hv-cinder-75671 Aug 24 14:46:52.067336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-a2728fd1-9a9f-4370-9d21-68674d48752d req-4feb3844-8d4a-4664-a20f-367cf11b600f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048988 Aug 24 14:46:52.068443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 442/851] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:52.945785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:52.946519 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:52.949050 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=4 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:52.963375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:52.963858 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:52.964888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:52.965851 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:52.966525 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:52.967107 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:53.230057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:53.245895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-78245060-92cb-4b5f-b56b-1ceada5cf0de tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.304851 Aug 24 14:46:53.260344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 410/852] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:52 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:54.282440 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:54.283754 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:54.301300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:54.302474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:54.308061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:54.309520 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:54.310453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:54.311228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:54.480202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:54.489773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1da10523-a58e-4bc9-b59a-46a4b5889b48 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.223800 Aug 24 14:46:54.491964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 443/853] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:54 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:55.514301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:55.515579 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:55.526193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:55.527105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:55.527564 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:55.528340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:55.528802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:55.529353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:55.747336 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:55.761844 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fc2b0ce6-5bca-4b32-93ae-ac93f0d40f2e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.252264 Aug 24 14:46:55.773150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 411/854] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:55 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:56.718685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-0d4f18cb-b626-47f8-a7be-58a23b1a502a req-72e8c695-3aa0-4802-9c71-e4cd115b8e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e58813-5807-452b-ae56-f0aeeb215ac9", "name": "network-vif-plugged", "status": "completed", "tag": "21285ac6-45a9-46f0-94fd-debd0b98b3ba"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:56.742381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-0d4f18cb-b626-47f8-a7be-58a23b1a502a req-72e8c695-3aa0-4802-9c71-e4cd115b8e6e service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:56.743492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-0d4f18cb-b626-47f8-a7be-58a23b1a502a req-72e8c695-3aa0-4802-9c71-e4cd115b8e6e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:56.744426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-0d4f18cb-b626-47f8-a7be-58a23b1a502a req-72e8c695-3aa0-4802-9c71-e4cd115b8e6e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:56.773832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-0d4f18cb-b626-47f8-a7be-58a23b1a502a req-72e8c695-3aa0-4802-9c71-e4cd115b8e6e service nova] Creating event network-vif-plugged:21285ac6-45a9-46f0-94fd-debd0b98b3ba for instance a4e58813-5807-452b-ae56-f0aeeb215ac9 on hv-cinder-75671 Aug 24 14:46:56.784376 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-0d4f18cb-b626-47f8-a7be-58a23b1a502a req-72e8c695-3aa0-4802-9c71-e4cd115b8e6e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075196 Aug 24 14:46:56.790087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:56.790972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 444/855] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:46:56.791132 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:56.801037 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:56.801540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:56.802001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:56.802790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:56.803248 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:56.808018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:57.002995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:57.016452 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a99b8376-ec5f-44c7-a3b4-22c37b33eca2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.235051 Aug 24 14:46:57.017044 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 412/856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:56 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:57.763456 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-79c045f2-98b5-4171-b1e8-98a120ecb4d5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Action: 'create', calling method: .version_select at 0x7fbf7c2e3f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1191018195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5VAhY2Bn9CPw5T4xnmPcRHrke9otL1DALWlOt7ZWPFskn0G18/kMNK962NJmK2hB7S8X0FCoysDuPRA0gia6V5iy5COqetR0cfng2vE97S/hFWoguwU6XO69sl6m+LOA=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:57.783294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-79c045f2-98b5-4171-b1e8-98a120ecb4d5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Getting quotas for project 1a8ff5bc8c6d4adaac8b73d5dfadfc31. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:57.788926 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-79c045f2-98b5-4171-b1e8-98a120ecb4d5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Getting quotas for user cde1ea819e2d47e8b1a8ef5247bc61e0 and project 1a8ff5bc8c6d4adaac8b73d5dfadfc31. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:57.882855 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-79c045f2-98b5-4171-b1e8-98a120ecb4d5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.127267 Aug 24 14:46:57.883633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 445/857] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:46:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:46:57.940495 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-535201328", "imageRef": "6557d9ce-7e14-4dd8-ae61-942c3806f079", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1191018195", "networks": [{"uuid": "485c78c7-0abf-4cd5-b724-9044fb8aea2d"}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:46:58.004855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] validate_networks() for [('485c78c7-0abf-4cd5-b724-9044fb8aea2d', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:46:58.039609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:58.040350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:58.049865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:58.050362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:58.050798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:58.051505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:58.051957 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:58.052377 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:58.290435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:58.298235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2a4c45b3-8f0c-4b44-9deb-a816486abefb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.263342 Aug 24 14:46:58.299016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 446/858] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:58 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:58.559938 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:46:58.560349 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:46:58.561015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:46:58.561414 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:46:58.561844 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:46:58.572136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:58.572627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:58.573057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:58.573801 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:58.574252 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:58.574671 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:58.594668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Getting quotas for project 1a8ff5bc8c6d4adaac8b73d5dfadfc31. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:46:58.598997 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Getting quotas for user cde1ea819e2d47e8b1a8ef5247bc61e0 and project 1a8ff5bc8c6d4adaac8b73d5dfadfc31. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:46:58.612361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:46:58.614745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6557d9ce-7e14-4dd8-ae61-942c3806f079',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:46:58.758819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5379022b-e394-4d4e-bc78-a53daad1535a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823403 Aug 24 14:46:58.759531 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 413/859] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:46:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:46:58.770558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-18eed998-dbd0-4d54-932c-bb8a1232215c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:58.771141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-18eed998-dbd0-4d54-932c-bb8a1232215c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:58.843194 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-18eed998-dbd0-4d54-932c-bb8a1232215c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:58.851848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-18eed998-dbd0-4d54-932c-bb8a1232215c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1258 microversion: 2.1 time: 0.085171 Aug 24 14:46:58.852685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 447/860] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:58 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:46:59.328862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:59.329634 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:59.338927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:59.339412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:59.339874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:59.340574 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:46:59.341025 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:46:59.341619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:46:59.811284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:59.820331 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f4e3175f-cd1b-4976-beb5-e6aa749b019a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1367 microversion: 2.1 time: 0.497018 Aug 24 14:46:59.821041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 414/861] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:59 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:46:59.878558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9df62ca1-e0cd-431f-9288-2a9e8e3e7783 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:46:59.880515 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9df62ca1-e0cd-431f-9288-2a9e8e3e7783 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:46:59.884547 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:46:59.955670 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9df62ca1-e0cd-431f-9288-2a9e8e3e7783 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:46:59.969952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9df62ca1-e0cd-431f-9288-2a9e8e3e7783 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1258 microversion: 2.1 time: 0.097965 Aug 24 14:46:59.970214 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 448/862] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:46:59 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1258 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:00.847918 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:00.848965 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:00.853145 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:00.861327 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:00.861967 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:00.862679 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:00.863876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:00.864616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:00.865328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:00.872180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:00.992675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:00.993422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:01.001119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:01.001695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:01.002175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:01.002902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:01.003357 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:01.003775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:01.079701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:01.088882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-59c7e575-522b-49ac-b1ec-37899ef1d2fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1310 microversion: 2.1 time: 0.101401 Aug 24 14:47:01.089529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 449/863] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:00 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1310 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:01.197532 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:01.211796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b945610a-49d5-458f-b938-9db7203c46d8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1556 microversion: 2.1 time: 0.371057 Aug 24 14:47:01.212375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 415/864] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:00 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1556 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:01.233839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:01.234336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:01.240700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:01.241694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:01.242204 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:01.243043 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:01.243425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:01.243963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:01.358760 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a9cb98f6-5fdf-42c6-8d04-f326dc98b3df tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128734 Aug 24 14:47:01.359721 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 450/865] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 14:47:01 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:47:02.111490 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:02.112429 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:02.120935 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:02.121464 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:02.121975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:02.122782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:02.123245 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:02.123832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:02.202093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:02.217780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0109b79e-c339-4514-bbc2-32ecf1966bed tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1316 microversion: 2.1 time: 0.109675 Aug 24 14:47:02.219661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 416/866] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:02 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1316 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:03.247604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:03.250342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:03.269869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:03.271577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:03.274947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:03.276101 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:03.276101 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:03.276660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:03.579097 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:03.650137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-eeb55931-6902-445c-a489-4502bf1a56a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.393596 Aug 24 14:47:03.650137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 451/867] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:03 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:03.655455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-c77010a4-5dcc-4d13-981c-6bee35766d42 req-664224f7-a14f-4c77-967f-55d50a8d8952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e58813-5807-452b-ae56-f0aeeb215ac9", "tag": "21285ac6-45a9-46f0-94fd-debd0b98b3ba"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:03.677880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c77010a4-5dcc-4d13-981c-6bee35766d42 req-664224f7-a14f-4c77-967f-55d50a8d8952 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:03.680692 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c77010a4-5dcc-4d13-981c-6bee35766d42 req-664224f7-a14f-4c77-967f-55d50a8d8952 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:03.681301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c77010a4-5dcc-4d13-981c-6bee35766d42 req-664224f7-a14f-4c77-967f-55d50a8d8952 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:03.720526 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-c77010a4-5dcc-4d13-981c-6bee35766d42 req-664224f7-a14f-4c77-967f-55d50a8d8952 service nova] Creating event network-changed:21285ac6-45a9-46f0-94fd-debd0b98b3ba for instance a4e58813-5807-452b-ae56-f0aeeb215ac9 on hv-cinder-75671 Aug 24 14:47:03.731577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-c77010a4-5dcc-4d13-981c-6bee35766d42 req-664224f7-a14f-4c77-967f-55d50a8d8952 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094094 Aug 24 14:47:03.732652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 417/868] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:04.667163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:04.667794 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:04.676624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:04.677132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:04.677604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:04.679068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:04.679538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:04.679978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:04.886238 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:04.899374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-41f80647-ba91-44cc-a145-f286056c30e2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.237695 Aug 24 14:47:04.900832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 452/869] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:04 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:05.926819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:05.929340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:05.939301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:05.939885 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:05.940548 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:05.941777 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:05.942359 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:05.942782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:06.167634 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:06.187500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e70a0b7a-6493-4b69-9668-fe8d44ea6d20 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.269520 Aug 24 14:47:06.188400 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 418/870] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:05 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:07.215050 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:07.215750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:07.222911 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:07.223460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:07.223947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:07.224712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:07.225819 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:07.226452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:07.401788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:07.410296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e1be0a71-6d5d-4636-bc68-241e730e3bee tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.199548 Aug 24 14:47:07.413132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 453/871] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:07 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:08.433211 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:08.433904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:08.440807 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:08.441287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:08.441740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:08.442456 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:08.442902 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:08.443516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:08.582366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:08.606923 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:08.696497 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:08.712293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e04e0e5f-c1f8-435b-bd92-f339da77a5ab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.278105 Aug 24 14:47:08.712293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 419/872] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:08 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:09.621922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-42535d2b-7628-45aa-bf46-48e23bcff12c req-4ab6d3eb-0d5b-4bc8-a9fd-357374966d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc", "tag": "ec8669f1-ee91-4159-b9e1-63f57ffa91f6"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:09.634942 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-42535d2b-7628-45aa-bf46-48e23bcff12c req-4ab6d3eb-0d5b-4bc8-a9fd-357374966d93 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:09.635839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-42535d2b-7628-45aa-bf46-48e23bcff12c req-4ab6d3eb-0d5b-4bc8-a9fd-357374966d93 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:09.636348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-42535d2b-7628-45aa-bf46-48e23bcff12c req-4ab6d3eb-0d5b-4bc8-a9fd-357374966d93 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:09.654826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-42535d2b-7628-45aa-bf46-48e23bcff12c req-4ab6d3eb-0d5b-4bc8-a9fd-357374966d93 service nova] Creating event network-changed:ec8669f1-ee91-4159-b9e1-63f57ffa91f6 for instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc on hv-cinder-75671 Aug 24 14:47:09.661115 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-42535d2b-7628-45aa-bf46-48e23bcff12c req-4ab6d3eb-0d5b-4bc8-a9fd-357374966d93 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045819 Aug 24 14:47:09.662030 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 454/873] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:09.735711 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:09.737039 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:09.746634 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:09.747424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:09.747861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:09.748645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:09.749306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:09.749734 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:09.933778 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:09.948159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-28158934-f4f3-41f6-9da4-b28fbab1e2ea tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.221036 Aug 24 14:47:09.948741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 420/874] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:09 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:10.967451 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=8 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:10.972762 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:10.973470 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:10.980797 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:10.981605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:10.982070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:10.989045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:10.989045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:10.989045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:10.989045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:11.158254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:11.167388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-abfb3b5b-c70b-4bdb-bbb5-7f3645abed63 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.200807 Aug 24 14:47:11.168013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 455/875] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:10 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:12.190856 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:12.191904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:12.200428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:12.200976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:12.201421 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:12.202167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:12.202621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:12.203059 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:12.364350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:12.376785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d74abde4-b774-4312-9da7-ce17643e7580 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.191401 Aug 24 14:47:12.384364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 421/876] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:12 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:13.401006 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:13.401628 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:13.408347 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:13.408830 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:13.409279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:13.410014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:13.410478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:13.411023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:13.548069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:13.556931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4938f999-f1ba-4f9c-9b5c-13886346e920 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.160030 Aug 24 14:47:13.557506 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 456/877] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:13 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:14.583581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:14.584263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:14.590960 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:14.591434 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:14.591864 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:14.592558 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:14.592996 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:14.593417 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:14.734514 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:14.743995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bbd46272-5511-4b75-9b7d-b0f2b245abd5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.164453 Aug 24 14:47:14.744707 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 422/878] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:14 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:15.772615 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:15.773203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:15.779653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:15.780141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:15.780575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:15.781289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:15.781737 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:15.782182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:15.920100 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:15.929188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-94491115-1530-4c29-a360-c25ea2e3da42 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.160354 Aug 24 14:47:15.929815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 457/879] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:15 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:16.951052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:16.951652 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:16.958416 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:16.958898 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:16.959349 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:16.960451 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:16.960913 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:16.961328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:17.099700 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:17.108590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-edc5e974-88ac-4cd0-8b34-749338a4a06d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.161229 Aug 24 14:47:17.109172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 423/880] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:16 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:18.132008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:18.132717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:18.139548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:18.140033 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:18.140461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:18.141159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:18.141606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:18.142060 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:18.332993 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:18.342593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5fc5bb15-c858-46ea-9a2d-1ae84ae2aca5 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.215215 Aug 24 14:47:18.344624 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 458/881] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:18 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:19.365099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:19.366029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:19.372837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:19.381696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:19.381696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:19.381696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:19.381696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:19.382156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:19.525586 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:19.533628 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-88c9ec8a-e334-4eb2-88de-468201b9901a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.172545 Aug 24 14:47:19.536328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 424/882] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:19 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:20.556205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:20.556825 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:20.563516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:20.564060 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:20.564508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:20.565208 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:20.565654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:20.566104 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:20.704880 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:20.712978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-70838ccb-beb9-4082-8aa6-bbe34468f479 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.161347 Aug 24 14:47:20.713559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 459/883] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:20 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:21.734726 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:21.735423 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:21.745439 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:21.746280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:21.747023 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:21.747744 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:21.748212 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:21.748660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:21.899358 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:21.907728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a4fd5088-2a02-42d6-b19c-037757439a6a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.176849 Aug 24 14:47:21.908315 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 425/884] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:21 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:22.928890 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:22.929642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:22.936146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:22.936625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:22.937048 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:22.937735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:22.938221 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:22.938622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:23.074292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:23.082382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-70736d52-ede5-42ed-bcb5-881919726f2d tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.157614 Aug 24 14:47:23.082965 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 460/885] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:22 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:24.104688 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:24.105393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:24.112309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:24.112798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:24.113222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:24.113970 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:24.114412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:24.114829 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:24.262732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:24.270980 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d75dc183-fc42-484e-bf7c-08a484f802a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.171054 Aug 24 14:47:24.271563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 426/886] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:24 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:24.643695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-c69297c2-556c-4f6f-b632-e79e0192dc6c req-c7cb3159-2c0c-4a7b-93cf-911ae0045fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc", "name": "network-vif-plugged", "status": "completed", "tag": "ec8669f1-ee91-4159-b9e1-63f57ffa91f6"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:24.655359 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c69297c2-556c-4f6f-b632-e79e0192dc6c req-c7cb3159-2c0c-4a7b-93cf-911ae0045fe8 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:24.655359 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c69297c2-556c-4f6f-b632-e79e0192dc6c req-c7cb3159-2c0c-4a7b-93cf-911ae0045fe8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:24.655359 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c69297c2-556c-4f6f-b632-e79e0192dc6c req-c7cb3159-2c0c-4a7b-93cf-911ae0045fe8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:24.669691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-c69297c2-556c-4f6f-b632-e79e0192dc6c req-c7cb3159-2c0c-4a7b-93cf-911ae0045fe8 service nova] Creating event network-vif-plugged:ec8669f1-ee91-4159-b9e1-63f57ffa91f6 for instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc on hv-cinder-75671 Aug 24 14:47:24.676243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-c69297c2-556c-4f6f-b632-e79e0192dc6c req-c7cb3159-2c0c-4a7b-93cf-911ae0045fe8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036346 Aug 24 14:47:24.677246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 461/887] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:25.293964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:25.294549 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:25.301649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:25.302173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:25.302607 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:25.303372 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:25.304495 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:25.304929 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:25.466900 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:25.480106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7cd75360-ab03-4320-89c1-2f8de524debe tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.189988 Aug 24 14:47:25.480990 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 427/888] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:25 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:26.514054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:26.514660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:26.521015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:26.521498 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:26.521963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:26.523244 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:26.523727 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:26.524128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:26.668552 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:26.676179 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8b02b953-edb7-4e56-abbe-9f7123ac90a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1358 microversion: 2.1 time: 0.166989 Aug 24 14:47:26.676805 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 462/889] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:26 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:27.697162 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:27.697771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:27.704395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.704873 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.705298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.706012 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.706459 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.706875 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.845813 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:27.855013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-24713d9c-621d-4cc2-a520-0e5ece398a13 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1547 microversion: 2.1 time: 0.162015 Aug 24 14:47:27.855583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 428/890] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:27 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:27.876197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:27.876813 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:27.887785 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.887785 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.887785 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:27.887785 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:27.888296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:27.888296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.037252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:28.046178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cd85eda0-ebc4-4a55-b7b0-d1cedd0b23fd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1547 microversion: 2.1 time: 0.174014 Aug 24 14:47:28.046769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 463/891] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:27 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:28.067520 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:28.072616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:28.073388 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Searching by: {'deleted': False, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31'} {{(pid=132892) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 14:47:28.080171 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.080654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.081097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.081831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.082282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.082702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.180745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.multi_cell_list [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132892) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 14:47:28.283476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d8ae04b3-f9a8-4c35-bfe8-97d6cbd4a988 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.220021 Aug 24 14:47:28.284049 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 429/892] 10.222.0.65 () {58 vars in 1125 bytes} [Wed Aug 24 14:47:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:28.295934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:28.296541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:28.302572 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.303054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.304090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.304869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:28.305326 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:28.305780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:28.441423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:28.449618 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-25654349-22d4-43f6-bb12-ae154db89a93 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1547 microversion: 2.1 time: 0.157529 Aug 24 14:47:28.450217 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 464/893] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:28 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:31.411399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a412ea-9894-4f7c-bf87-28f497d9f99e"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:31.414482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:31.416815 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=30 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:31.421574 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.427874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.427874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.427874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:31.427874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:31.428476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:31.428476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=87 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:32.199064 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3b4c28bc-9ced-4bb6-90dc-e1c0f9760eab tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "POST /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791543 Aug 24 14:47:32.199710 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 430/894] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:47:31 2022] POST /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:47:35.773121 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:35.773665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:35.775742 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=36 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:35.780654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:35.781182 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:35.781730 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:35.786918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:35.786918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:35.786918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:35.808724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5fa91cd2-3915-4cd4-b565-a7737797efc0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/ips" status: 200 len: 150 microversion: 2.20 time: 0.040673 Aug 24 14:47:35.809488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 465/895] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 24 14:47:35 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:47:39.083401 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:39.088871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:39.089711 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:39.099361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:39.099849 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:39.103640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:39.104100 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:39.105039 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:39.105471 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:39.131811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lazy-loading 'flavor' on Instance uuid 61a26d59-b1af-4dba-9aaf-bcd473a6b21e {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:47:39.719353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-56c3b23a-f15e-4959-9171-570badc7ba0b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/action" status: 202 len: 0 microversion: 2.20 time: 0.561874 Aug 24 14:47:39.719353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 431/896] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 24 14:47:39 2022] POST /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:47:39.719553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:39.719553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:39.719553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:39.719553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:39.720153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:39.720153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:39.720153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:39.720153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:39.843499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:39.853330 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:39.854928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:39.856119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d0a19e66-19cd-4ee5-8141-76045455b76d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.207047 Aug 24 14:47:39.856693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 466/897] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:39 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:40.893457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:40.894434 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:40.895099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:40.895285 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:40.902251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.902818 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.903393 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.903570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.904068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.904252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.904500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.904700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.904980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:40.905194 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:40.905650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:40.906101 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:41.113016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:41.115409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=70 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:41.123310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1178f26f-ebd6-439e-97a9-c46d3467b9b6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1593 microversion: 2.1 time: 0.232591 Aug 24 14:47:41.123897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 467/898] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:40 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1593 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:47:41.129468 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:41.142293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:41.143818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:41.145056 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7df4ecff-76e4-4205-a5e0-7ef23dcd677a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.260141 Aug 24 14:47:41.145641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 432/899] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:40 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:42.173473 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:42.174906 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:42.184249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.184735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.185176 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.185939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:42.186408 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:42.186831 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:42.453029 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:42.462467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:42.463924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:42.465099 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ecf6aeea-2870-458c-a3ff-ca9f535a3673 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.299819 Aug 24 14:47:42.465664 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 468/900] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:42 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:43.490071 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:43.491009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:43.499944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.500436 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.500889 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.501588 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.502081 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.502509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.714285 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:43.724790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:43.727306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:43.728524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1c626469-f443-4d05-9ffc-09863a0c95ba tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.243493 Aug 24 14:47:43.729317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 433/901] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:43 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:43.862314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-3f6c85f4-57eb-4f97-9a4c-d60c7fb5aad8 req-9999950b-1d2b-4cd1-a4bc-d3677176925b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc", "tag": "ec8669f1-ee91-4159-b9e1-63f57ffa91f6"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:43.878951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-3f6c85f4-57eb-4f97-9a4c-d60c7fb5aad8 req-9999950b-1d2b-4cd1-a4bc-d3677176925b service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:43.879435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-3f6c85f4-57eb-4f97-9a4c-d60c7fb5aad8 req-9999950b-1d2b-4cd1-a4bc-d3677176925b service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:43.879867 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-3f6c85f4-57eb-4f97-9a4c-d60c7fb5aad8 req-9999950b-1d2b-4cd1-a4bc-d3677176925b service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:43.893556 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-3f6c85f4-57eb-4f97-9a4c-d60c7fb5aad8 req-9999950b-1d2b-4cd1-a4bc-d3677176925b service nova] Creating event network-changed:ec8669f1-ee91-4159-b9e1-63f57ffa91f6 for instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc on hv-cinder-75671 Aug 24 14:47:43.898594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-3f6c85f4-57eb-4f97-9a4c-d60c7fb5aad8 req-9999950b-1d2b-4cd1-a4bc-d3677176925b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041161 Aug 24 14:47:43.899162 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 469/902] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:44.757429 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:44.758701 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:44.766008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.766495 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.766924 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.767630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:44.768304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:44.769041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:44.922843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:44.934298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:44.936098 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:44.937375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8c737c35-5d9d-4355-979a-ede2981e2b17 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.186063 Aug 24 14:47:44.937969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 434/903] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:44 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:45.964696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:45.965425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:45.972049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:45.972437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:45.972883 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:45.973587 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:45.974069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:45.974494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:46.375367 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:46.385701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:46.387319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:46.388907 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2b27b39a-417c-4a63-aef1-f7d7473104f4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.429740 Aug 24 14:47:46.389610 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 470/904] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:45 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:46.651261 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-44644919"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:46.651827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:46.659744 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:46.660220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:46.660693 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:46.661378 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:46.661852 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:46.662269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:46.809518 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.network.security_group_api [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Adding security group d150e1a4-1f98-4f12-9b64-0686890f64dc to port ec8669f1-ee91-4159-b9e1-63f57ffa91f6 Aug 24 14:47:47.209506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3011fe7d-6eb8-41ee-8a8f-c35f88ed6f27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "POST /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/action" status: 202 len: 0 microversion: 2.1 time: 0.562296 Aug 24 14:47:47.210160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 435/905] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:47:46 2022] POST /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:47:47.218287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:47.218896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:47.223998 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-1b9ece30-3fbe-4d68-b814-89d36139891c req-4751e707-62a7-41ca-ab4c-65cfa39b466a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc", "tag": "ec8669f1-ee91-4159-b9e1-63f57ffa91f6"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:47:47.225231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.228164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.228164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.228164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.228164 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.228826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.241171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-1b9ece30-3fbe-4d68-b814-89d36139891c req-4751e707-62a7-41ca-ab4c-65cfa39b466a service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.241171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-1b9ece30-3fbe-4d68-b814-89d36139891c req-4751e707-62a7-41ca-ab4c-65cfa39b466a service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.241171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-1b9ece30-3fbe-4d68-b814-89d36139891c req-4751e707-62a7-41ca-ab4c-65cfa39b466a service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.255091 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-1b9ece30-3fbe-4d68-b814-89d36139891c req-4751e707-62a7-41ca-ab4c-65cfa39b466a service nova] Creating event network-changed:ec8669f1-ee91-4159-b9e1-63f57ffa91f6 for instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc on hv-cinder-75671 Aug 24 14:47:47.262209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-1b9ece30-3fbe-4d68-b814-89d36139891c req-4751e707-62a7-41ca-ab4c-65cfa39b466a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046406 Aug 24 14:47:47.263620 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 471/906] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:47:47.420453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:47.421168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:47.426077 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.433004 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.433502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.433971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.434685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:47.435288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:47.435898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:47.438788 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9c5bcad8-16ed-4ec6-a031-bea56f5ca994 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1757 microversion: 2.1 time: 0.224386 Aug 24 14:47:47.439886 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 436/907] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:47:47 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:47:47.603234 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.615643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.618187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:47.619282 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4f563a53-d926-4159-9176-3385c846546e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.207167 Aug 24 14:47:47.620022 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 472/908] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:47 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:47:48.642919 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:48.643528 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:48.650846 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.651338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.651775 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.652477 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:48.652926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:48.653351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:48.812112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:48.821001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:48.822669 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:48.823859 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3856566a-eb50-4380-9179-62bc43bbc979 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.184900 Aug 24 14:47:48.824424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 437/909] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:48 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:49.849626 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:49.850322 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:49.858062 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:49.858544 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:49.858968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:49.859692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:49.860136 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:49.860558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:50.006287 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:50.015388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:50.016881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:50.018068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-19a704ce-7d48-416e-95e6-8ad5996b7cfa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.173311 Aug 24 14:47:50.018618 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 473/910] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:49 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:51.042299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:51.042895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:51.049548 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.050061 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.050489 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.051175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:51.051632 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:51.052055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:51.196360 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:51.206384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:51.206662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:51.207832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c740de89-74a6-44f6-a9d6-74cb021a62f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.169852 Aug 24 14:47:51.208385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 438/911] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:51 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:52.232949 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:52.233559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:52.241541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:52.242688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:52.243120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:52.243819 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:52.244279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:52.244702 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:52.464467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:52.473032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:52.474548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:52.475715 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-839b9430-9519-442c-90e5-7dcdf00174f6 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.246766 Aug 24 14:47:52.477137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 474/912] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:52 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:53.501310 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:53.501876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:53.509284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:53.509826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:53.510267 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:53.511036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:53.511474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:53.511899 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:53.696329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:53.704645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:53.706241 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:53.707482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-29eac690-17de-4d66-bc90-fcb11ec3fd40 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.210164 Aug 24 14:47:53.708033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 439/913] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:53 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:54.731036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:54.731788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:54.738333 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:54.738842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:54.739262 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:54.739962 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:54.740419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:54.740845 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:54.883326 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.892935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.894475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:54.895648 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-09f25b4d-136f-48a9-be2e-01dee4f34463 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.168663 Aug 24 14:47:54.896201 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 475/914] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:54 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:55.922973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:55.922973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:55.927748 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.928243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.928670 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:55.930012 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:55.930464 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:55.930881 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:56.088893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:56.097679 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:56.099204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:56.100589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eeaba591-cae1-4d98-bff7-033cb8061980 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.183902 Aug 24 14:47:56.102168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 440/915] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:55 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:57.124768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:57.125504 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:57.132187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:57.133204 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:57.133637 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.134371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:57.134822 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:57.135247 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:57.282169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:57.292058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:57.293564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:57.294849 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1baf3678-d4c0-47f1-acd4-b34796cf4d20 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.174147 Aug 24 14:47:57.295410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 476/916] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:57 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:58.322973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:58.323539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:58.329821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:58.330299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:58.330741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:58.331640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:58.332082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:58.332501 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:58.481624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:58.490255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:58.491811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:58.493006 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e6e6e7dc-3a0c-441f-8bab-b51d0ce2d95b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.178076 Aug 24 14:47:58.493570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 441/917] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:58 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:47:59.518254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:47:59.518254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:47:59.524373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:59.524898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:59.525340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:59.526084 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:47:59.526542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:47:59.526968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:47:59.667383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:59.676999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:59.678776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:47:59.680606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e9b1f21f-43ab-462c-bf94-d4a6f1238c09 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.167602 Aug 24 14:47:59.681342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 477/918] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:47:59 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:00.707378 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:00.707987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:00.715850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:00.716340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:00.716759 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:00.717451 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:00.717921 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:00.718335 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:00.901540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:00.910336 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:00.912063 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:00.913839 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1a4860ea-36fd-482d-baaf-08a8e72edc3e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1741 microversion: 2.20 time: 0.210483 Aug 24 14:48:00.914413 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 442/919] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:00 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:01.938300 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:01.938856 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:01.945464 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:01.945990 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:01.946429 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:01.947132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:01.947588 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:01.948014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.090297 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:02.099278 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:02.101730 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:02.103166 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0c4d44ca-0e98-4079-be39-d4fb2387942a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1741 microversion: 2.20 time: 0.169079 Aug 24 14:48:02.105425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 478/920] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:01 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:02.694745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-123016fd-a64a-4fa7-8b7c-de95b9aa9972 req-6f9a3c52-a6a7-451b-b7ce-847bbb53234a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a26d59-b1af-4dba-9aaf-bcd473a6b21e", "name": "network-vif-plugged", "status": "completed", "tag": "d04c4d4d-11af-427e-8e6f-526632a4a642"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:02.700470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=26 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:02.705631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-123016fd-a64a-4fa7-8b7c-de95b9aa9972 req-6f9a3c52-a6a7-451b-b7ce-847bbb53234a service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:02.706139 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-123016fd-a64a-4fa7-8b7c-de95b9aa9972 req-6f9a3c52-a6a7-451b-b7ce-847bbb53234a service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:02.710052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-123016fd-a64a-4fa7-8b7c-de95b9aa9972 req-6f9a3c52-a6a7-451b-b7ce-847bbb53234a service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:02.710052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:02.718370 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-123016fd-a64a-4fa7-8b7c-de95b9aa9972 req-6f9a3c52-a6a7-451b-b7ce-847bbb53234a service nova] Creating event network-vif-plugged:d04c4d4d-11af-427e-8e6f-526632a4a642 for instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e on hv-cinder-75671 Aug 24 14:48:02.723362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-123016fd-a64a-4fa7-8b7c-de95b9aa9972 req-6f9a3c52-a6a7-451b-b7ce-847bbb53234a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032322 Aug 24 14:48:02.723949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 443/921] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:03.127636 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:03.128171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:03.135174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:03.135659 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:03.136087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:03.136783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:03.137230 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:03.137647 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:03.275280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:03.284832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:03.286382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:03.287614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-714c578e-341d-43e4-8798-f2a42ecb2d93 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1741 microversion: 2.20 time: 0.164028 Aug 24 14:48:03.288179 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 479/922] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:03 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:04.454203 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:04.454926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:04.461099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:04.461686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:04.462254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:04.462944 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:04.463396 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:04.463821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:04.611736 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:04.621502 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:04.623043 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:04.624218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-af197daa-f4ea-4ab9-ab2d-0e9fb0bc647d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1741 microversion: 2.20 time: 0.315985 Aug 24 14:48:04.625134 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 444/923] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:04 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:05.649577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:05.650286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:05.656583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:05.657066 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:05.657526 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:05.658259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:05.658712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:05.659140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:05.803893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:05.814088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:05.815590 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:05.816760 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7e38e87f-032b-4bab-b5ec-e25b034902e1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1741 microversion: 2.20 time: 0.171916 Aug 24 14:48:05.817336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 480/924] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:05 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:06.841317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:06.841979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:06.848762 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.849244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.849675 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.850414 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:06.850869 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:06.851548 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:06.989601 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:06.998362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:06.999862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:07.001020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aa71228b-f878-4aec-aeb1-a128f5d1f6c8 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1741 microversion: 2.20 time: 0.163767 Aug 24 14:48:07.001575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 445/925] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:06 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:08.025519 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:08.026190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:08.028841 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=32 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:08.033601 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:08.034288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:08.034723 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:08.035424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:08.035874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:08.036293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:08.182724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:08.191279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:08.192773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:08.193963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-54f173a0-48d6-4958-850e-91fc37bc3e2a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1741 microversion: 2.20 time: 0.173564 Aug 24 14:48:08.194524 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 481/926] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:08 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:09.216958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:09.217580 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:09.224717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:09.225244 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:09.225689 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:09.227315 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:09.228027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:09.228453 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:09.381638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:09.391314 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:09.392935 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:09.394163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fdf44cb5-2663-4c23-951f-6a75a2312a7f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.181183 Aug 24 14:48:09.394734 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 446/927] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:09 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:10.109096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1883988113", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-624897609", "security_groups": [{"name": "tempest-secgroup-smoke-1621191805"}], "block_device_mapping_v2": [{"uuid": "7bacea3a-dd7c-4586-b3f4-f24f14e0c7a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2213b9d9-5655-4f75-b8cc-83ad6d8a04df"}]}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:10.253661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] validate_networks() for [('2213b9d9-5655-4f75-b8cc-83ad6d8a04df', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:48:10.433661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:10.436211 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:10.458746 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:10.459749 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:10.460577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:10.462143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:10.463330 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:10.464042 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:10.746412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:10.756787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:10.762057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:10.767848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-135492ff-4eb5-4285-9f1b-421dadeff298 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.348435 Aug 24 14:48:10.768776 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 447/928] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:10 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:10.908445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:48:10.909105 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:48:10.909840 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:48:10.910490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:48:10.911324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:48:10.922038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:10.922938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:10.923597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:10.924705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:10.925384 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:10.926150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:10.951310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Getting quotas for project f22a1cf1a07c47a29772e70e4586a77b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:48:10.957109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Getting quotas for user 3b7c54ebd95f4b3eb396982d75615f23 and project f22a1cf1a07c47a29772e70e4586a77b. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:48:11.044560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:48:11.046801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bacea3a-dd7c-4586-b3f4-f24f14e0c7a4',volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:48:11.488933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1e2b3377-76e7-4145-a691-b9fcfbe7dc76 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.383503 Aug 24 14:48:11.502689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 482/929] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:48:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:48:11.516178 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ec5c475f-312e-44cf-a2a0-aec550689bdf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:11.519093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ec5c475f-312e-44cf-a2a0-aec550689bdf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:11.636475 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ec5c475f-312e-44cf-a2a0-aec550689bdf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:11.645381 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ec5c475f-312e-44cf-a2a0-aec550689bdf tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1094 microversion: 2.1 time: 0.135211 Aug 24 14:48:11.649020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 448/930] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:11 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1094 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:11.801177 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:11.804106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:11.818989 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:11.821106 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:11.822749 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:11.824148 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:11.824891 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:11.825336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:12.037620 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:12.048929 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:12.051231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:12.052577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3a26942b-2983-45a9-bfc9-8de4fde7c878 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.263463 Aug 24 14:48:12.053141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 483/931] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:11 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:12.675514 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3ab5fdb9-d230-4b26-891e-63f490092223 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:12.676246 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3ab5fdb9-d230-4b26-891e-63f490092223 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:12.743447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3ab5fdb9-d230-4b26-891e-63f490092223 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:12.754706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3ab5fdb9-d230-4b26-891e-63f490092223 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1094 microversion: 2.1 time: 0.084013 Aug 24 14:48:12.755295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 449/932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:12 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:13.078885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:13.078885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:13.086222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:13.086811 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:13.088060 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:13.088729 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:13.089208 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:13.089639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:13.096437 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=86 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:13.292404 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:13.307002 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:13.308681 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:13.309933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1b6d449b-dd9d-4e7b-933b-2c4936bb8b4d tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.236118 Aug 24 14:48:13.321509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 484/933] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:13 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:13.778150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:13.779032 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:13.786903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:13.787521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:13.788019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:13.788819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:13.790146 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:13.790677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:13.885674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:13.905026 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4ddad007-5240-4ad7-9b58-00160473a176 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1136 microversion: 2.1 time: 0.132668 Aug 24 14:48:13.915082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 450/934] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:13 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1136 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:14.338543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:14.340159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:14.346936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:14.347692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:14.348306 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:14.349192 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:14.349652 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:14.350093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:14.548351 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:14.557979 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:14.559632 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:14.561088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3c04f1db-b524-4e17-ae54-5c62b6572460 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.227938 Aug 24 14:48:14.580416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 485/935] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:14 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:14.930612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:14.931780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:14.940235 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:14.942213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:14.942862 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:14.943448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:14.943930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:14.944337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:15.055453 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:15.067689 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-22e66c0d-487c-41ea-a577-5e0f6f65e1a7 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1200 microversion: 2.1 time: 0.144015 Aug 24 14:48:15.077907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 451/936] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:14 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1200 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:15.587718 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:15.588427 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:15.598457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:15.598947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:15.599382 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:15.600091 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:15.601907 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:15.603262 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:15.784931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:15.803299 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:15.805728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:15.808392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d48507f1-3362-4b73-850e-7c6af8b0c412 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.224675 Aug 24 14:48:15.810483 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 486/937] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:15 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:16.096722 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:16.097879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:16.111294 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:16.113419 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:16.116389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:16.118654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:16.120884 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:16.122482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:16.349167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:16.366833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ae7d00d9-ee28-4089-bdb8-6d60365abf25 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1278 microversion: 2.1 time: 0.273996 Aug 24 14:48:16.374314 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 452/938] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:16 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:16.834381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:16.834935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:16.841174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:16.841630 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:16.842094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:16.842877 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:16.843323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:16.843741 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:16.987653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:16.997461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:16.999000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:17.000189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b03c2ec8-a5b6-4665-b394-473c740a94eb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.170180 Aug 24 14:48:17.000759 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 487/939] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:16 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:17.300308 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-c663246e-5a30-489a-8272-f705bd970eeb req-93e08144-cc27-48f9-9c4c-c3aec030312c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599967fc-b96a-4a4f-af19-c62a990493cd", "tag": "31ab6709-e979-4e0b-94f0-4467aab2487c"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:17.313933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c663246e-5a30-489a-8272-f705bd970eeb req-93e08144-cc27-48f9-9c4c-c3aec030312c service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:17.326547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c663246e-5a30-489a-8272-f705bd970eeb req-93e08144-cc27-48f9-9c4c-c3aec030312c service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:17.326547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-c663246e-5a30-489a-8272-f705bd970eeb req-93e08144-cc27-48f9-9c4c-c3aec030312c service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:17.330904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-c663246e-5a30-489a-8272-f705bd970eeb req-93e08144-cc27-48f9-9c4c-c3aec030312c service nova] Creating event network-changed:31ab6709-e979-4e0b-94f0-4467aab2487c for instance 599967fc-b96a-4a4f-af19-c62a990493cd on hv-cinder-75671 Aug 24 14:48:17.336326 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-c663246e-5a30-489a-8272-f705bd970eeb req-93e08144-cc27-48f9-9c4c-c3aec030312c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048286 Aug 24 14:48:17.337053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 453/940] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:48:17.393401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:17.394399 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:17.400922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:17.401793 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:17.402639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:17.403583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:17.404445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:17.405087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:17.571770 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:17.585289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5475b378-eb1d-4106-9d9c-2013bb624b5b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.192828 Aug 24 14:48:17.598527 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 488/941] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:17 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:18.029771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:18.030470 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:18.044690 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:18.045254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:18.045711 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:18.046479 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:18.046939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:18.047365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:18.225021 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:18.238281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:18.249170 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:18.250749 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d933b0ae-da76-419d-b214-90080753f934 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.228805 Aug 24 14:48:18.251673 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 454/942] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:18 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:18.613597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:18.614465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:18.622726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:18.623217 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:18.623659 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:18.624362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:18.625024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:18.625605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:18.792493 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:18.809091 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-895f6803-32a1-4318-b90a-edbe3ed3aab6 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.199502 Aug 24 14:48:18.809989 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 489/943] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:18 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:19.282843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:19.283430 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:19.291183 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:19.292306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:19.292644 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:19.293352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:19.293831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:19.294261 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:19.452519 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:19.463649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:19.465156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:19.466437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-798cb81f-741f-4f10-b5f5-3e969bc1c594 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.189003 Aug 24 14:48:19.472722 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 455/944] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:19 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:19.835707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:19.836787 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:19.844915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:19.845671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:19.846364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:19.847307 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:19.848114 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:19.848874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:20.007833 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:20.016822 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-94ade3db-724f-4eaf-a6e2-17cb4c0f99c1 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.184982 Aug 24 14:48:20.017614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 490/945] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:19 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:20.491123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:20.492401 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:20.499887 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:20.500383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:20.500824 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:20.501529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:20.506435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:20.506824 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:20.686295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:20.694952 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:20.696481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:20.697654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ad32c633-e189-46c3-8aae-45f5bbb7f8ec tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.210410 Aug 24 14:48:20.704982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 456/946] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:20 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:21.043267 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:21.043932 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:21.046537 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:21.047742 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=6 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:21.052807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:21.053294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:21.053722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:21.054471 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:21.054949 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:21.055370 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:21.201529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:21.209487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b0fbe8ae-d946-4c0c-9bfa-82b1e32b9c1a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.175015 Aug 24 14:48:21.210086 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 491/947] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:21 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:21.723365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:21.723951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:21.731150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:21.731637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:21.732070 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:21.732793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:21.733243 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:21.733663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:21.876410 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:21.885086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:21.886615 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:21.887774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bd229989-0c75-488f-86d7-2095129859f3 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.168444 Aug 24 14:48:21.888434 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 457/948] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:21 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:22.234988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:22.235907 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:22.245340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:22.245941 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:22.246384 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:22.247090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:22.247543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:22.248000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:22.403639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:22.413057 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ef2f63ba-3d57-46de-9706-edf0b473a698 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.182244 Aug 24 14:48:22.413643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 492/949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:22 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:22.911368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:22.911965 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:22.914477 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=4 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:22.919397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:22.919877 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:22.920308 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:22.920991 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:22.921460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:22.921907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:23.062117 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:23.070344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:23.072606 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:23.073774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4a148c17-e385-47f8-95a6-6cffb183383f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1736 microversion: 2.20 time: 0.166424 Aug 24 14:48:23.074341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 458/950] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:22 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:23.444008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:23.444710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:23.451709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:23.452192 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:23.452625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:23.453345 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:23.453865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:23.454310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:23.589931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:23.597668 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cadbd2a1-0f62-4770-88d4-7893c7b4ef04 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.157588 Aug 24 14:48:23.598274 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 493/951] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:23 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:24.097082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:24.097684 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:24.105599 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:24.106103 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:24.106533 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:24.107218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:24.107662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:24.108072 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:24.259232 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:24.269071 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:24.270893 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:24.272119 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-533cb35b-2488-4be9-8a35-2553a81602a4 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1718 microversion: 2.20 time: 0.178919 Aug 24 14:48:24.272699 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 459/952] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:24 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1718 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:24.618669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:24.619907 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:24.626815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:24.627235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:24.627673 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:24.628407 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:24.628863 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:24.629290 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:24.771461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:24.783898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-95408509-75a0-4251-b579-da9635a3ce74 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.169059 Aug 24 14:48:24.784484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 494/953] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:24 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:25.298414 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:25.299061 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:25.305900 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:25.307017 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:25.307455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:25.308153 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:25.308601 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:25.309019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:25.446935 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:25.456156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:25.457653 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:25.458870 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d04863a3-f121-4083-a2e1-ec420ca07bdb tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1718 microversion: 2.20 time: 0.166387 Aug 24 14:48:25.459424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 460/954] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:25 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:25.805680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:25.806961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:25.813596 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:25.814127 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:25.814572 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:25.815279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:25.815737 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:25.816165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:25.967782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:25.977160 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f8214919-76ad-45e6-8fd5-0626143da974 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.175367 Aug 24 14:48:25.977781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 495/955] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:25 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:26.483115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:26.483712 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:26.490442 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:26.490922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:26.491353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:26.492041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:26.492486 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:26.492904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:26.635530 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:26.644406 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:26.645910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:26.647095 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e20833b1-0974-4d99-8682-c732d38fd4ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1718 microversion: 2.20 time: 0.168714 Aug 24 14:48:26.647646 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 461/956] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:26 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:26.754865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-2a79f4fb-3a3c-4ebb-b95a-6b7aa66b0fb9 req-aa9489bb-718c-4d89-ab14-75b2c9ac1eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a26d59-b1af-4dba-9aaf-bcd473a6b21e", "name": "network-vif-unplugged", "status": "completed", "tag": "d04c4d4d-11af-427e-8e6f-526632a4a642"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:26.765575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2a79f4fb-3a3c-4ebb-b95a-6b7aa66b0fb9 req-aa9489bb-718c-4d89-ab14-75b2c9ac1eed service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:26.773923 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2a79f4fb-3a3c-4ebb-b95a-6b7aa66b0fb9 req-aa9489bb-718c-4d89-ab14-75b2c9ac1eed service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:26.773923 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2a79f4fb-3a3c-4ebb-b95a-6b7aa66b0fb9 req-aa9489bb-718c-4d89-ab14-75b2c9ac1eed service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:26.777475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-2a79f4fb-3a3c-4ebb-b95a-6b7aa66b0fb9 req-aa9489bb-718c-4d89-ab14-75b2c9ac1eed service nova] Creating event network-vif-unplugged:d04c4d4d-11af-427e-8e6f-526632a4a642 for instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e on hv-cinder-75671 Aug 24 14:48:26.782512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-2a79f4fb-3a3c-4ebb-b95a-6b7aa66b0fb9 req-aa9489bb-718c-4d89-ab14-75b2c9ac1eed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033616 Aug 24 14:48:26.783113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 496/957] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:26.999996 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:27.000597 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:27.008808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:27.010138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:27.010280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:27.011067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:27.011529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:27.011958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:27.148840 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:27.157097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-36384b83-45c0-4edc-b83f-c78a54fbf055 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.160900 Aug 24 14:48:27.157676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 462/958] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:26 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:27.673765 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:27.674461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:27.680731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:27.681248 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:27.681689 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:27.682422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:27.682897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:27.683334 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:27.831369 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:27.840595 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:27.842123 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:27.843327 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b7f68c06-66ad-444b-b5cd-0a22a1796174 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1718 microversion: 2.20 time: 0.174514 Aug 24 14:48:27.843908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 497/959] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:27 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1718 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:28.179430 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:28.180685 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:28.187988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:28.188469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:28.188897 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:28.189586 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:28.190062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:28.190483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:28.193242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:28.344173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:28.352718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bcf65566-a7f4-491c-b4b1-5248041fbbdd tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.177118 Aug 24 14:48:28.353816 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 463/960] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:28 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:28.867001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:28.867608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:28.875033 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:28.875523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:28.875957 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:28.876775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:28.877230 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:28.877796 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:29.025329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:29.035611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:29.037270 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:29.038487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-36bff08b-aeb0-45cf-9182-8113e70e2bfd tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1721 microversion: 2.20 time: 0.175486 Aug 24 14:48:29.039043 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 498/961] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:28 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:29.062520 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e4fb8d3-9d91-48b0-8a0e-32c07c2f37eb"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:29.064826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:29.071038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:29.076065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:29.076065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:29.076065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:29.076065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:29.076539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:29.374410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:29.375026 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:29.381071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:29.381563 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:29.382190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:29.382888 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:29.383350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:29.383779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:29.518246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:29.525860 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1ef2863b-52ec-42ee-b64b-448c209a4722 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.155542 Aug 24 14:48:29.527136 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 499/962] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:29 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:30.221940 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0c90f804-e478-4249-b730-1935755412fc tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.163446 Aug 24 14:48:30.222484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 464/963] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 24 14:48:29 2022] POST /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/os-volume_attachments => generated 188 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 14:48:30.362118 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:30.362654 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:30.369231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:30.369811 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:30.370253 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:30.370998 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:30.371478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:30.371872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:30.461279 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:30.548786 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:30.549393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:30.556334 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:30.556849 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:30.557328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:30.558083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:30.558531 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:30.558951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:30.703502 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:30.713126 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-da76c392-fe4f-4336-8751-a96dca99ea4a tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.168249 Aug 24 14:48:30.714479 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 465/964] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:30 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:31.094619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-6aabf2a1-e296-4f61-826e-f8711008605f req-626db25c-1ebf-41d9-8c8d-0390d1ebfc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599967fc-b96a-4a4f-af19-c62a990493cd", "name": "network-vif-plugged", "status": "completed", "tag": "31ab6709-e979-4e0b-94f0-4467aab2487c"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:31.104625 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6aabf2a1-e296-4f61-826e-f8711008605f req-626db25c-1ebf-41d9-8c8d-0390d1ebfc95 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.105114 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6aabf2a1-e296-4f61-826e-f8711008605f req-626db25c-1ebf-41d9-8c8d-0390d1ebfc95 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.105570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-6aabf2a1-e296-4f61-826e-f8711008605f req-626db25c-1ebf-41d9-8c8d-0390d1ebfc95 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.118648 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-6aabf2a1-e296-4f61-826e-f8711008605f req-626db25c-1ebf-41d9-8c8d-0390d1ebfc95 service nova] Creating event network-vif-plugged:31ab6709-e979-4e0b-94f0-4467aab2487c for instance 599967fc-b96a-4a4f-af19-c62a990493cd on hv-cinder-75671 Aug 24 14:48:31.123742 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-6aabf2a1-e296-4f61-826e-f8711008605f req-626db25c-1ebf-41d9-8c8d-0390d1ebfc95 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035502 Aug 24 14:48:31.124335 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 466/965] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:48:31.170707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3b6bf5e2-7c46-44a5-b725-8e11344554ef tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "DELETE /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/os-volume_attachments/4e4fb8d3-9d91-48b0-8a0e-32c07c2f37eb" status: 202 len: 0 microversion: 2.20 time: 0.812146 Aug 24 14:48:31.171571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 500/966] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 24 14:48:30 2022] DELETE /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/os-volume_attachments/4e4fb8d3-9d91-48b0-8a0e-32c07c2f37eb => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:48:31.238031 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:31.238716 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:31.245429 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.245961 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.246398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.247100 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.247561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.248137 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.354755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132892) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 14:48:31.722463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b2bcc213-3e3f-4d03-97f0-99dd5e27fa53 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "POST /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/action" status: 202 len: 0 microversion: 2.20 time: 0.489188 Aug 24 14:48:31.723187 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 467/967] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 24 14:48:31 2022] POST /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:48:31.734814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:31.735876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:31.739974 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:31.741007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:31.744443 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.744933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.745413 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.746594 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.747101 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.747527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.755786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.759282 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.759553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.760644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:31.762139 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:31.763447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:31.976785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:31.979988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:31.986559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7fe5dde8-832c-457a-9d44-03eb95a7d04b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.255567 Aug 24 14:48:31.987627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 468/968] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:31 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:31.989117 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:31.990884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:31.992384 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cabf0fd1-4df1-40c7-a4be-a8fa861b5b25 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1669 microversion: 2.20 time: 0.264232 Aug 24 14:48:32.002163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 501/969] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:31 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:33.008650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:33.009251 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:33.017210 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:33.017793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:33.017957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:33.018065 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:33.018263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:33.018969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:33.019425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:33.020024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:33.024587 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:33.025081 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:33.025609 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:33.026286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:33.026819 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:33.027268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:33.240204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:33.249088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:33.253108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7ad5bb09-0bd9-4911-90b5-d4e400fb45ad tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1266 microversion: 2.1 time: 0.247256 Aug 24 14:48:33.253517 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 469/970] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:33 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:33.261734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:33.265073 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:33.267395 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8929bdca-a89f-4f16-a61f-853c689c230e tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1669 microversion: 2.20 time: 0.253865 Aug 24 14:48:33.277926 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 502/971] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:33 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1669 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:34.283560 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:34.284189 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:34.291110 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.293780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.293780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.293780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.294087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:34.294534 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.294534 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.294705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:34.300780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.301266 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.301699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.302425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.302872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.303296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.518928 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:34.528731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0fc27a0d-10ac-4ec5-97f1-89601a00fa15 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1454 microversion: 2.1 time: 0.248938 Aug 24 14:48:34.529359 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 470/972] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:34 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1454 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:48:34.532732 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:34.545426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:34.547029 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:34.548396 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8fb47ab8-0b45-4b28-8f23-0f77e49967ae tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1671 microversion: 2.20 time: 0.259128 Aug 24 14:48:34.549075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 503/973] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:34 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1671 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:34.550989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:34.551599 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:34.553600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:34.560002 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.560492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.560919 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.561612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.562167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.566508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.712017 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:34.720696 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e56b5d06-9f75-402a-84b7-785f582ede08 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1454 microversion: 2.1 time: 0.173445 Aug 24 14:48:34.721284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 471/974] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:48:34 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:48:34.796694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:34.797188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:34.804126 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.804126 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.804594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.805292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:34.805775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:34.806200 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:34.842165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-761b48a1-e97d-45a7-ad96-0948ceccda5c tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/ips" status: 200 len: 147 microversion: 2.1 time: 0.049166 Aug 24 14:48:34.843378 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 504/975] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:48:34 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:35.574329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:35.575474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:35.583048 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:35.583461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:35.583897 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:35.584603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:35.585227 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:35.585585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:35.734807 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:35.743079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:35.744557 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:35.746544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df7b69b7-3030-47ee-8310-90ca86dd67f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.176252 Aug 24 14:48:35.747327 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 472/976] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:35 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:36.773496 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:36.774873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:36.784301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:36.789183 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:36.789183 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:36.789183 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:36.789183 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:36.789809 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:36.973467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:36.988543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:36.994739 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:36.997523 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-85005534-d0ec-4693-b0dd-fb4ff0f0c1aa tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.229447 Aug 24 14:48:36.998231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 505/977] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:36 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:37.538097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "289ab7a7-c3d2-4b05-9da2-454820787b7c"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:37.540839 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:37.548631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:37.549225 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:37.549738 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:37.551158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:37.551158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:37.552155 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:37.648339 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-09366a25-2006-4be0-ad43-78ce162e6064 req-c38ec72e-4b46-4baa-b49f-8091a7d18571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599967fc-b96a-4a4f-af19-c62a990493cd", "tag": "31ab6709-e979-4e0b-94f0-4467aab2487c"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:37.672046 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-09366a25-2006-4be0-ad43-78ce162e6064 req-c38ec72e-4b46-4baa-b49f-8091a7d18571 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:37.672886 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-09366a25-2006-4be0-ad43-78ce162e6064 req-c38ec72e-4b46-4baa-b49f-8091a7d18571 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:37.673194 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-09366a25-2006-4be0-ad43-78ce162e6064 req-c38ec72e-4b46-4baa-b49f-8091a7d18571 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:37.688077 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-09366a25-2006-4be0-ad43-78ce162e6064 req-c38ec72e-4b46-4baa-b49f-8091a7d18571 service nova] Creating event network-changed:31ab6709-e979-4e0b-94f0-4467aab2487c for instance 599967fc-b96a-4a4f-af19-c62a990493cd on hv-cinder-75671 Aug 24 14:48:37.693340 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-09366a25-2006-4be0-ad43-78ce162e6064 req-c38ec72e-4b46-4baa-b49f-8091a7d18571 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055740 Aug 24 14:48:37.693983 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 506/978] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:38.024079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:38.024773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:38.034146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:38.034663 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:38.035094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:38.035792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:38.036240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:38.036688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:38.206201 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:38.222841 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:38.224347 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:38.226916 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-16c841e3-a3ce-42f8-94d1-e5c5766b9912 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.206217 Aug 24 14:48:38.242388 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 507/979] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:38 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:39.251049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:39.251710 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:39.254087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:39.258988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:39.259526 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:39.260163 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:39.260878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:39.261852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:39.262286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:39.408887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:39.417111 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:39.419060 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:39.420363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-95884e46-54b4-4e68-96a7-88b3843919d1 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.173172 Aug 24 14:48:39.420931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 508/980] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:39 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:40.444826 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:40.446478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:40.454076 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:40.454855 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:40.455294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:40.455997 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:40.456614 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:40.457055 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:40.626613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:40.635233 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:40.637272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:40.638492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f1ed2e23-bf55-44b8-914f-ab760fc0ed42 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.198162 Aug 24 14:48:40.639064 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 509/981] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:40 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:41.662922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:41.663746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:41.671275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:41.671879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:41.672325 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:41.673071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:41.673628 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:41.674131 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:41.859165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:41.867896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:41.870422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:41.871232 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-137fa389-3905-46bb-8b6c-1f66f9cad99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.212247 Aug 24 14:48:41.872686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 510/982] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:41 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:42.898406 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:42.904724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:42.906773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:42.907272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:42.907709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:42.908427 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:42.908878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:42.909303 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:43.092218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:43.109976 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:43.111530 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:43.112706 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c5b2ecd7-b8d2-4a93-9ef7-7fb495337222 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.218283 Aug 24 14:48:43.113499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 511/983] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:42 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:43.268827 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:43.269330 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:43.276049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:43.276735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:43.277183 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:43.277939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:43.278951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:43.279391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:43.305389 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-734b34f1-fa51-4bd7-b9ba-1d8bb484e4b4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/ips" status: 200 len: 148 microversion: 2.1 time: 0.040605 Aug 24 14:48:43.306258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 512/984] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:48:43 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:44.136683 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:44.138758 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:44.145682 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:44.146241 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:44.146700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:44.147470 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:44.147996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:44.148446 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:44.316841 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:44.332129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:44.333810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:44.334961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dd590931-6cef-4f41-8dcb-78102d833d96 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.202337 Aug 24 14:48:44.335771 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 513/985] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:44 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:45.359274 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:45.359999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:45.366492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:45.366982 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:45.367417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:45.368140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:45.368659 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:45.369087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:45.539695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:45.548161 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:45.549656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:45.550917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a872d706-a532-4930-aa25-31abe868c237 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.196241 Aug 24 14:48:45.551404 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 514/986] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:45 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:46.575604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:46.576457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:46.582986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:46.583472 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:46.583908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:46.584605 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:46.585061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:46.585700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:46.735301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:46.743739 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:46.745453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:46.747148 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9de0fc20-92eb-48c4-8226-e5d8c3422e38 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.175820 Aug 24 14:48:46.747934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 515/987] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:46 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:48:46.752978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99521866-cb71-40bd-98a8-e60f55cdd515"}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:46.755390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:46.765401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:46.765957 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:46.766413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:46.767108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:46.767566 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:46.767987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:46.847108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=4 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:47.546785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=5 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:47.688046 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:56.765943 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=17 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:57.928982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fb36c78b-6469-43e5-a119-cfcf083e13bd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 20.394845 Aug 24 14:48:57.929607 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-6a533071-ea21-4076-a122-3efe7c180d93 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.179914 Aug 24 14:48:57.936503 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 473/988] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:48:37 2022] POST /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments => generated 194 bytes in 20397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:57.936645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 516/989] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:48:46 2022] POST /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments => generated 194 bytes in 11182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:57.936759 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:57.936759 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:57.943329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:57.943745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:57.944179 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:57.944916 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:57.945366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:57.945802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:58.091387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:58.099866 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:58.101635 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:58.102828 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-92e17af7-1b1b-4bde-9b44-c06e081c13ff tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.171472 Aug 24 14:48:58.103390 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 474/990] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:57 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:48:59.129731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:48:59.129731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:48:59.135453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:59.135952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:59.136386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:59.137107 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:59.137556 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:59.138018 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:59.157954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-3a19e222-4f9b-47ee-83b8-9aa6faecfa73 req-337d30d3-7b50-4218-b497-a17871257da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a26d59-b1af-4dba-9aaf-bcd473a6b21e", "name": "network-vif-plugged", "status": "completed", "tag": "d04c4d4d-11af-427e-8e6f-526632a4a642"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:48:59.168542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-3a19e222-4f9b-47ee-83b8-9aa6faecfa73 req-337d30d3-7b50-4218-b497-a17871257da5 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:48:59.169024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-3a19e222-4f9b-47ee-83b8-9aa6faecfa73 req-337d30d3-7b50-4218-b497-a17871257da5 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:48:59.169452 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-3a19e222-4f9b-47ee-83b8-9aa6faecfa73 req-337d30d3-7b50-4218-b497-a17871257da5 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:48:59.184154 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-3a19e222-4f9b-47ee-83b8-9aa6faecfa73 req-337d30d3-7b50-4218-b497-a17871257da5 service nova] Creating event network-vif-plugged:d04c4d4d-11af-427e-8e6f-526632a4a642 for instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e on hv-cinder-75671 Aug 24 14:48:59.190002 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-3a19e222-4f9b-47ee-83b8-9aa6faecfa73 req-337d30d3-7b50-4218-b497-a17871257da5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035695 Aug 24 14:48:59.190946 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 475/991] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:48:59.292154 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:59.301984 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:59.303350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:48:59.304923 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-09cede8f-3587-43af-ae24-9b1b8ba920f5 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.181790 Aug 24 14:48:59.305370 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 517/992] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:48:59 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:00.332389 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:00.333025 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:00.339619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:00.340123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:00.340603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:00.341312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:00.341773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:00.342215 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:00.477267 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:00.486347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:00.487915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:00.489064 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e13c7984-0e91-4d6f-8781-fdbc394de78f tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.163335 Aug 24 14:49:00.489623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 476/993] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:00 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:01.512543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:01.513185 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:01.520475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:01.520964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:01.521408 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:01.522141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:01.522603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:01.523026 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:01.673100 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:01.683492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:01.690080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:01.690080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-99f0b7a3-f075-49aa-85cf-94a1c535f13a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.177724 Aug 24 14:49:01.690080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 518/994] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:01 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:02.711040 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:02.711670 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:02.718948 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:02.719444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:02.727680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:02.727680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:02.727680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:02.727680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:02.861403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:02.869630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:02.871220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:02.872371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-44388c60-61e4-4043-878f-38cc8c4cff68 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1727 microversion: 2.20 time: 0.165423 Aug 24 14:49:02.872931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 477/995] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:02 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:03.896255 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:03.896872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:03.903611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:03.912481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:03.912481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:03.912481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:03.912481 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:03.912898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:04.043492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:04.052445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:04.053972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:04.060639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ebebccbb-10f5-49ce-95c0-fb9a81cdc99a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1714 microversion: 2.20 time: 0.163110 Aug 24 14:49:04.060639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 519/996] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:49:03 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:49:06.581182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:06.583413 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:06.589864 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.590353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.594206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.594206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.594206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.594206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.623198 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9211d037-4538-4ec1-a692-83227f1064d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Aug 24 14:49:06.625994 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 478/997] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:49:06 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:06.635323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:06.635800 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:06.642997 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.643482 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.643922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.644617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:06.645074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:06.645501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:06.675678 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9435f0e5-68a7-4102-8bc8-dc0f008b88f1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/289ab7a7-c3d2-4b05-9da2-454820787b7c" status: 200 len: 194 microversion: 2.1 time: 0.044241 Aug 24 14:49:06.677894 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 520/998] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 24 14:49:06 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/289ab7a7-c3d2-4b05-9da2-454820787b7c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:09.347708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1086f3cd-690c-4e21-9f2f-b1d4828e765f"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:09.350352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:09.356918 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.357396 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.357907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:09.358610 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:09.359056 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:09.359479 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:10.088654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dbd16222-9c5c-4591-8a27-1a2327ebe2c7 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "POST /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744812 Aug 24 14:49:10.089272 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 479/999] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:49:09 2022] POST /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:14.021808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-567fc855-1865-4979-a894-8daf9524227b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: .version_select at 0x7fbf7c1d0c10>, body: {"keypair": {"name": "tempest-keypair-142687427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDly0wtH9GxmKtJ4qtGUoBpZqId+7RozwNMLxNN2Rk4fy71WxtGc0owArf3LFPve9b3tt0y5RIO6Y/S3pHreyWcbjffsErfm7yK3ZQS1I516nX3MPHUlBWwpcTP+B3NyLw=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:14.038203 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-567fc855-1865-4979-a894-8daf9524227b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for project 13d426499b5b40818dca1573cb839b16. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:49:14.047493 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-567fc855-1865-4979-a894-8daf9524227b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for user f88f7857e1d24bb0b038b7f6e98a6f34 and project 13d426499b5b40818dca1573cb839b16. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:49:14.054132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR oslo.messaging._drivers.impl_rabbit [None req-567fc855-1865-4979-a894-8daf9524227b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [2ae3587a-d9a0-43cf-8716-baf10a6dc6f2] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 14:49:15.061572 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [None req-567fc855-1865-4979-a894-8daf9524227b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [2ae3587a-d9a0-43cf-8716-baf10a6dc6f2] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 49836. Aug 24 14:49:15.148322 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-567fc855-1865-4979-a894-8daf9524227b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.130673 Aug 24 14:49:15.148931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 521/1000] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:49:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:17.971945 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-974133215", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72239629-4056-40ff-9127-a5a5ca07ba84"}], "security_groups": [{"name": "tempest-securitygroup--74117593"}], "key_name": "tempest-keypair-142687427", "user_data": "}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:18.083297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] validate_networks() for [('72239629-4056-40ff-9127-a5a5ca07ba84', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:49:18.478158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:49:18.478634 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:49:18.479096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:49:18.479496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:49:18.479898 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:49:18.489283 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:18.489772 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:18.490205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:18.490915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:18.491356 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:18.491771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:18.499024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:18.509739 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for project 13d426499b5b40818dca1573cb839b16. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:49:18.513680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for user f88f7857e1d24bb0b038b7f6e98a6f34 and project 13d426499b5b40818dca1573cb839b16. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:49:18.524850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:49:18.527220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:49:18.686159 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-50670da9-33e0-4a89-90cb-7729ba600f6d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.719558 Aug 24 14:49:18.686813 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 480/1001] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:49:17 2022] POST /compute/v2.1/servers => generated 400 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:49:18.695391 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:18.699612 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9ba5ed30-6d7c-4137-91d4-29266832c7e0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:18.700089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9ba5ed30-6d7c-4137-91d4-29266832c7e0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:18.757555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9ba5ed30-6d7c-4137-91d4-29266832c7e0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:18.765400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9ba5ed30-6d7c-4137-91d4-29266832c7e0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1240 microversion: 2.1 time: 0.071287 Aug 24 14:49:18.766911 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 522/1002] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:18 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:19.787773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cc163c93-4ee8-4a31-9fe0-57f605e55594 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:19.788384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cc163c93-4ee8-4a31-9fe0-57f605e55594 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:19.843623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cc163c93-4ee8-4a31-9fe0-57f605e55594 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:19.851018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cc163c93-4ee8-4a31-9fe0-57f605e55594 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1240 microversion: 2.1 time: 0.068309 Aug 24 14:49:19.851676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 481/1003] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:19 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:20.872556 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:20.873275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:20.881058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:20.881272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:20.881705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:20.882432 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:20.882880 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:20.883306 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:20.948314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:20.956552 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-55566f54-7d95-43a3-a9c0-1b7597a7c6b2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1236 microversion: 2.1 time: 0.088346 Aug 24 14:49:20.957117 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 523/1004] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:20 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:21.978493 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:21.983223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:21.987167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:21.987673 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:21.988111 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:21.988827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:21.989289 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:21.989727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.065076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:22.074248 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:22.077535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:22.081644 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0d6d564c-7e27-4d40-aeb7-cc7fa536dfce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1292 microversion: 2.1 time: 0.107372 Aug 24 14:49:22.082278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 482/1005] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:21 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1292 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:22.084077 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.084565 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.084997 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.085925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.086346 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.086766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.119823 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-26fa97c7-1e8e-4cdc-ae44-dfc5b6a6cb4e tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049697 Aug 24 14:49:22.120445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 524/1006] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:49:22 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:22.272467 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:22.272954 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:22.279373 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.279850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.280286 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.280967 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.281410 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.281901 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.312698 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-268906a3-2b20-4d82-bb0a-4407c3bdb8ce tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/289ab7a7-c3d2-4b05-9da2-454820787b7c" status: 200 len: 194 microversion: 2.1 time: 0.044456 Aug 24 14:49:22.313301 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 483/1007] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 24 14:49:22 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/289ab7a7-c3d2-4b05-9da2-454820787b7c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:49:22.323996 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:22.324484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:22.330450 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.331551 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.332098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.332725 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:22.333200 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:22.333617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:22.414636 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lazy-loading 'services' on Instance uuid a1843548-9be2-41a0-a8a7-1f7897083355 {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:49:22.713543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-be951f76-6993-4340-ba6f-52afa9621917 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/289ab7a7-c3d2-4b05-9da2-454820787b7c" status: 202 len: 0 microversion: 2.1 time: 0.393405 Aug 24 14:49:22.714178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 525/1008] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:49:22 2022] DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/289ab7a7-c3d2-4b05-9da2-454820787b7c => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:49:23.104070 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:23.104637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:23.111007 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:23.111488 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:23.111932 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:23.113112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:23.113521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:23.113974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:23.181411 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:23.189040 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e81bfde8-c1e7-4fd4-9691-e8658bfe7339 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1298 microversion: 2.1 time: 0.089241 Aug 24 14:49:23.189668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 484/1009] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:23 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:24.212155 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:24.212941 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:24.219555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.220740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.220740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.221218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.221790 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.222175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.365310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:24.374129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5abc9a3b-0237-4800-b803-a496da921eb7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.166712 Aug 24 14:49:24.374735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 526/1010] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:24 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:24.622259 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-90949560-327f-41a0-8290-ee2ffab85673 req-5208803e-1fa2-4989-98fd-c477ef6c80fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6050d18-78e2-43dd-8006-bfbb0480d25a", "tag": "b16f8165-9a3b-4a2c-b254-8b71c5ae23b3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:24.632363 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-90949560-327f-41a0-8290-ee2ffab85673 req-5208803e-1fa2-4989-98fd-c477ef6c80fd service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.632826 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-90949560-327f-41a0-8290-ee2ffab85673 req-5208803e-1fa2-4989-98fd-c477ef6c80fd service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.633246 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-90949560-327f-41a0-8290-ee2ffab85673 req-5208803e-1fa2-4989-98fd-c477ef6c80fd service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.644941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-90949560-327f-41a0-8290-ee2ffab85673 req-5208803e-1fa2-4989-98fd-c477ef6c80fd service nova] Creating event network-changed:b16f8165-9a3b-4a2c-b254-8b71c5ae23b3 for instance b6050d18-78e2-43dd-8006-bfbb0480d25a on hv-cinder-75671 Aug 24 14:49:24.650573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-90949560-327f-41a0-8290-ee2ffab85673 req-5208803e-1fa2-4989-98fd-c477ef6c80fd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032213 Aug 24 14:49:24.651175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 485/1011] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:24.908227 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:24.908727 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:24.915452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.915999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.916485 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.917215 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.917669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.918115 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.953348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5f5f07b7-aadb-4bfe-bb4b-860e92011a40 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/1086f3cd-690c-4e21-9f2f-b1d4828e765f" status: 200 len: 194 microversion: 2.1 time: 0.048936 Aug 24 14:49:24.954167 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 527/1012] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 24 14:49:24 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/1086f3cd-690c-4e21-9f2f-b1d4828e765f => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:24.966079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:24.966926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:24.973536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.974168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.974612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:24.975571 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:24.976047 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:24.976463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.068293 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lazy-loading 'services' on Instance uuid a1843548-9be2-41a0-a8a7-1f7897083355 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:49:25.311793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6f33fb4f-0b12-41e3-8273-159edea3265d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/1086f3cd-690c-4e21-9f2f-b1d4828e765f" status: 202 len: 0 microversion: 2.1 time: 0.349814 Aug 24 14:49:25.313276 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 486/1013] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:49:24 2022] DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments/1086f3cd-690c-4e21-9f2f-b1d4828e765f => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:49:25.395364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:25.396601 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:25.404083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.405071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.405071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.405869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.406329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.406786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.556474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:25.564830 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9f655a55-4ea6-4a24-ae3d-da0236c8f956 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.173655 Aug 24 14:49:25.565392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 528/1014] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:25 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:25.835850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:25.838153 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:25.844575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.845060 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.845494 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:25.846223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:25.846675 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:25.847099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.163720 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-71feb343-427e-4438-ba5e-ab1714b3896a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "POST /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/action" status: 202 len: 0 microversion: 2.1 time: 0.332018 Aug 24 14:49:26.164319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 487/1015] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:49:25 2022] POST /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:49:26.173149 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:26.173784 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:26.180248 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:26.180731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:26.181199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.181886 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:26.182339 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:26.182802 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.337308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:26.346268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f1bac7c6-3556-474c-8351-c569e656d41b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1749 microversion: 2.1 time: 0.177113 Aug 24 14:49:26.346857 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 529/1016] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:26 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:26.587922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:26.588616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:26.595021 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:26.595499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:26.595936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.596616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:26.597060 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:26.597475 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:26.743807 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:26.752067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-5c3e22f6-69a0-4510-8272-3231359d41f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.168859 Aug 24 14:49:26.752485 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 488/1017] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:26 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:27.369236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:27.369881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:27.372381 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:27.377235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.377733 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.378298 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.378913 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.379377 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.383514 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.549610 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:27.558665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-22048518-4fd9-400b-849f-01e4f197fd36 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1749 microversion: 2.1 time: 0.193327 Aug 24 14:49:27.559401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 530/1018] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:27 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1749 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:27.773998 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:27.774602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:27.777009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:27.781874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.782376 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.782803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.783529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:27.783975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:27.784392 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:27.929020 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:27.937553 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4ec109b9-d171-4eb5-a553-7e716159f1c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.168506 Aug 24 14:49:27.938167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 489/1019] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:27 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:28.580213 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:28.580827 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:28.587715 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.588206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.588649 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.589358 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.589843 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.590275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.739766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:28.748672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-aa0a9a56-3f83-42db-81ab-c332cd17a6c1 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1749 microversion: 2.1 time: 0.172216 Aug 24 14:49:28.749247 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 531/1020] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:28 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:28.960965 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:28.961586 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:28.964698 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:28.968999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.969556 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.969961 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:28.970667 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:28.971113 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:28.971535 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.122396 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:29.132821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6028dce6-dd43-4752-9e60-6223c7019ecd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.175879 Aug 24 14:49:29.133415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 490/1021] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:28 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:29.741542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:29.746308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:29.747929 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=6 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:29.756622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.757371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.758113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.759220 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.760063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.760735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.778410 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:29.780529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:29.801115 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.803517 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-29fff5b8-2b80-49e5-b6a7-2d393aa25224 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068494 Aug 24 14:49:29.803517 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 532/1022] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:49:29 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:49:29.803956 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.804437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.806034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.810414 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.811192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.853502 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=8 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:29.948756 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:29.951329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:29.957626 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.959612 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.960062 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:29.960779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:29.961240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:29.961681 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.005995 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a3b74d23-c1b2-42b5-a376-69fec5e25e30 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062197 Aug 24 14:49:30.006593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 533/1023] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:49:29 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 14:49:30.011691 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:30.029731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-14b271ed-2a00-4bb3-94b5-db2c55f3a62e tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1749 microversion: 2.1 time: 0.255100 Aug 24 14:49:30.030941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 491/1024] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:29 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1749 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:30.100252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:30.100747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:30.107641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.108128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.108560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.109336 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.109803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.110235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.155265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:30.156286 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:30.163717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.164311 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.164949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.166005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.166660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.168026 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.288865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:49:30.323787 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:30.332127 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2f298139-eabe-48e4-b20c-93e20727ce0d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.180958 Aug 24 14:49:30.332741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 492/1025] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:30 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:49:30.695774 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4cd470d8-bfa1-4ee5-bb53-03cd0c91a16d tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 204 len: 0 microversion: 2.1 time: 0.599556 Aug 24 14:49:30.696361 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 534/1026] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:49:30 2022] DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:49:30.712012 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:30.712670 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:30.718644 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.719120 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.719549 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.720237 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:30.720674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:30.721196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:30.866436 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:30.873979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-90979476-b994-4b65-a9aa-66d097699303 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1675 microversion: 2.1 time: 0.166162 Aug 24 14:49:30.874555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 493/1027] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:30 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:31.065241 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:31.066242 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:31.073329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.074025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.074535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:31.075317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.075971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.076511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:31.245354 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:31.254207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-57af520f-117f-40cd-a951-afcceb37bce2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.193340 Aug 24 14:49:31.255425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 535/1028] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:31 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:31.354702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:31.355312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:31.362500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.362981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.363412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:31.364719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.365637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.365637 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:31.513516 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:31.521735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9f258b61-3d95-4f8f-b772-3cece34635da tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.172779 Aug 24 14:49:31.522339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 494/1029] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:31 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:31.897192 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:31.898442 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:31.906141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.906968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.907465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:31.908183 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:31.908638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:31.909068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.075156 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:32.083397 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dfad0d73-09a6-4075-90f6-1ae029c7b325 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1675 microversion: 2.1 time: 0.191887 Aug 24 14:49:32.084142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 536/1030] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:31 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:32.279737 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:32.280457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:32.287328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.287817 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.288550 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.289360 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.289720 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.290175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.452076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:32.461975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3943f9eb-ecb3-47e7-88be-2abcee63c407 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.186680 Aug 24 14:49:32.462555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 495/1031] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:32 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:49:32.543138 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:32.543747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:32.550005 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.550491 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.550925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.552208 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:32.552964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:32.553390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:32.557726 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:32.694786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:32.702688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-efea837b-b5f7-41d9-9723-9bf5708519c7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.163939 Aug 24 14:49:32.703253 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 537/1032] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:32 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:33.105546 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:33.106174 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:33.112957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.113438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.114006 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.115254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.115837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.116256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.262700 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:33.275521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f95f86d3-e798-476d-b9a0-0610a233ca47 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1675 microversion: 2.1 time: 0.173412 Aug 24 14:49:33.277144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 496/1033] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:33 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:33.484937 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:33.486731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:33.489540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-c33142b9-7de0-4e5b-9641-bf4671b53e93 req-b91327cf-2bfa-43ec-a399-e1c3598991c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6050d18-78e2-43dd-8006-bfbb0480d25a", "name": "network-vif-plugged", "status": "completed", "tag": "b16f8165-9a3b-4a2c-b254-8b71c5ae23b3"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:33.496112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.496986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.499665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.499665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.499665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.499665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.500189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c33142b9-7de0-4e5b-9641-bf4671b53e93 req-b91327cf-2bfa-43ec-a399-e1c3598991c8 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.500700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c33142b9-7de0-4e5b-9641-bf4671b53e93 req-b91327cf-2bfa-43ec-a399-e1c3598991c8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.501141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c33142b9-7de0-4e5b-9641-bf4671b53e93 req-b91327cf-2bfa-43ec-a399-e1c3598991c8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.513742 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-c33142b9-7de0-4e5b-9641-bf4671b53e93 req-b91327cf-2bfa-43ec-a399-e1c3598991c8 service nova] Creating event network-vif-plugged:b16f8165-9a3b-4a2c-b254-8b71c5ae23b3 for instance b6050d18-78e2-43dd-8006-bfbb0480d25a on hv-cinder-75671 Aug 24 14:49:33.518686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:33.521116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-c33142b9-7de0-4e5b-9641-bf4671b53e93 req-b91327cf-2bfa-43ec-a399-e1c3598991c8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039573 Aug 24 14:49:33.521643 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 538/1034] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:33.726603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:33.727402 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:33.731112 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:33.736702 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.737399 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.737653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.738556 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:33.739280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:33.739887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:33.743839 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ab9ab85f-5bd5-4f66-8458-b813c6f43f03 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.262652 Aug 24 14:49:33.747874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 497/1035] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:33 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:33.923298 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:33.932003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0cffebaa-4e0a-45d5-9e29-bafa71de898c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.211692 Aug 24 14:49:33.932952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 539/1036] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:33 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:49:34.302733 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:34.303399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:34.311761 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.312835 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.313256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:34.314187 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.314895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.315325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:34.381246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-559bbb5d-e98a-4e7b-a8e7-48e7e4b73ea7 req-ef341ff8-9dcb-4ced-b700-8a25b8859bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1843548-9be2-41a0-a8a7-1f7897083355", "name": "network-vif-deleted", "tag": "189b0de6-d6db-428a-a91a-189294ec2553"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:34.400885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-559bbb5d-e98a-4e7b-a8e7-48e7e4b73ea7 req-ef341ff8-9dcb-4ced-b700-8a25b8859bf8 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.400885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-559bbb5d-e98a-4e7b-a8e7-48e7e4b73ea7 req-ef341ff8-9dcb-4ced-b700-8a25b8859bf8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.400885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-559bbb5d-e98a-4e7b-a8e7-48e7e4b73ea7 req-ef341ff8-9dcb-4ced-b700-8a25b8859bf8 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:34.423218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:34.424927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-559bbb5d-e98a-4e7b-a8e7-48e7e4b73ea7 req-ef341ff8-9dcb-4ced-b700-8a25b8859bf8 service nova] Creating event network-vif-deleted:189b0de6-d6db-428a-a91a-189294ec2553 for instance a1843548-9be2-41a0-a8a7-1f7897083355 on hv-cinder-75671 Aug 24 14:49:34.434405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a6a80e8c-ce36-4d84-8254-bcc9aa4392d3 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1607 microversion: 2.1 time: 0.137057 Aug 24 14:49:34.434612 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-559bbb5d-e98a-4e7b-a8e7-48e7e4b73ea7 req-ef341ff8-9dcb-4ced-b700-8a25b8859bf8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059026 Aug 24 14:49:34.438229 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 540/1038] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:34.438865 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 498/1038] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:34 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1607 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:34.770425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:34.771658 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:34.779236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.779787 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.780171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:34.780885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.781338 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.781786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:34.942790 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:34.952406 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c9e44e67-99dc-4e79-a682-c23669fffda0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.186547 Aug 24 14:49:34.953801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 541/1039] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:34 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:34.954935 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:34.955918 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:34.963798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.964007 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.964659 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:34.965509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:34.966216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:34.966643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:35.126054 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:35.135986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-619dc910-633b-4d00-bf79-f34a9a30af80 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1364 microversion: 2.1 time: 0.183295 Aug 24 14:49:35.135986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 499/1040] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:34 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:49:35.458930 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:35.459823 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:35.468146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:35.468774 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:35.469345 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:35.470225 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:35.470782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:35.471304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:35.540509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:35.548735 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-6675726f-5ec0-46f9-83b9-8976658494d0 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1322 microversion: 2.1 time: 0.095596 Aug 24 14:49:35.549314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 542/1041] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:35 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:35.975342 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:35.975914 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:35.983219 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:35.983717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:35.984184 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:35.984962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:35.985412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:35.985906 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.139319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:36.148212 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4d3cf89b-b82d-47c2-a795-d43aff0faab6 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.177826 Aug 24 14:49:36.148788 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 500/1042] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:35 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:36.155851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:36.156594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:36.163111 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.163604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.164041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.164747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.165201 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.165638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.314692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:36.323953 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e3438b1d-4b76-4459-9afc-77190773d0e5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1553 microversion: 2.1 time: 0.172118 Aug 24 14:49:36.324554 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 543/1043] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:36 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:36.345936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:36.346433 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:36.353265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.353942 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.354449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.355234 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.355713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.356160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.441708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-80554c3d-2602-4727-945d-1b965d9d47b9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099819 Aug 24 14:49:36.443283 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 501/1044] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 14:49:36 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:36.570444 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:36.571050 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:36.577015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.577499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.577965 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.578659 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.579113 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.579532 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.614707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:36.615355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:36.615792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:36.616237 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lazy-loading 'fault' on Instance uuid a1843548-9be2-41a0-a8a7-1f7897083355 {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:49:36.717579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b3a886df740cda4a94e55d2fcc08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2395c1dafb6a4174a7dd095c4809c181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:36.727202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3ede6a0a-7327-42e2-8272-36d92355a233 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 200 len: 1327 microversion: 2.1 time: 0.160980 Aug 24 14:49:36.738012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 544/1045] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:36 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 1327 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:37.170062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:37.170589 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:37.176633 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:37.177274 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:37.177706 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:37.178689 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:37.179209 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:37.179683 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:37.458255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:37.466626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-db428f43-145b-4504-b1a6-c29afb32f3fc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.301119 Aug 24 14:49:37.467201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 502/1046] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:37 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:37.730799 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-e9f8d9a2-d2f0-480c-8b5e-a193c7642bac req-299556ec-4d4a-4be9-8f86-45a70a69099b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6050d18-78e2-43dd-8006-bfbb0480d25a", "tag": "b16f8165-9a3b-4a2c-b254-8b71c5ae23b3"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:37.740767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e9f8d9a2-d2f0-480c-8b5e-a193c7642bac req-299556ec-4d4a-4be9-8f86-45a70a69099b service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:37.741250 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e9f8d9a2-d2f0-480c-8b5e-a193c7642bac req-299556ec-4d4a-4be9-8f86-45a70a69099b service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:37.741685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-e9f8d9a2-d2f0-480c-8b5e-a193c7642bac req-299556ec-4d4a-4be9-8f86-45a70a69099b service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:37.748460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:37.749064 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:37.756070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-e9f8d9a2-d2f0-480c-8b5e-a193c7642bac req-299556ec-4d4a-4be9-8f86-45a70a69099b service nova] Creating event network-changed:b16f8165-9a3b-4a2c-b254-8b71c5ae23b3 for instance b6050d18-78e2-43dd-8006-bfbb0480d25a on hv-cinder-75671 Aug 24 14:49:37.757765 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:37.758350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:37.759536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:37.759865 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:37.760199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:37.760919 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:37.761528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-e9f8d9a2-d2f0-480c-8b5e-a193c7642bac req-299556ec-4d4a-4be9-8f86-45a70a69099b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096531 Aug 24 14:49:37.762392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 545/1047] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:37.777930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] HTTP exception thrown: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Request method failure captured: Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 HTTP/1.1 Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfTMTqeki7e1EmF8wpCXJEdeaHADumea9K7qtYIPe0YpLrwznCDwUeCElR8Zm6IihU5oxrYoJ2yIDhQDem6j7tuRhAagsfggjPzNWkWYvHdZpZT0X1aNv7iNxCGn2eJFoQLg1eAo2AwoE0EpFfSY6QBA3guaVJYMvfpTOsNK3wUKrQ Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:49:37.779781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}] Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 556b3a886df740cda4a94e55d2fcc08a Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:37.781424 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'a1843548-9be2-41a0-a8a7-1f7897083355'} Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:37.782382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:37.783981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:37.785236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Returning 404 to user: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:37.785236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-619ea75f-f273-48ac-9a0b-df382ef08396 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 404 len: 111 microversion: 2.1 time: 0.036582 Aug 24 14:49:37.785236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 503/1048] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:37 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:49:37.792225 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-999b77b8-98b1-498d-bde8-6a0508230cf1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '.version_select at 0x7fbf7c10c310>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:37.931951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-999b77b8-98b1-498d-bde8-6a0508230cf1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455678448" status: 202 len: 0 microversion: 2.1 time: 0.144003 Aug 24 14:49:37.936342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 546/1049] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 14:49:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455678448 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:49:38.490342 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:38.491205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:38.497382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:38.498102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:38.498549 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:38.499417 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:38.500024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:38.500444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:38.665660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:38.675455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-eef530c2-a980-4a93-80be-2d572d079855 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.190157 Aug 24 14:49:38.681854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 504/1050] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:38 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:39.700377 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:39.701151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:39.708348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:39.708855 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:39.709284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:39.710016 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:39.710470 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:39.710896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:39.868246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:39.877011 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ea276d4b-5913-449b-b67d-f7eae18a2450 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.181403 Aug 24 14:49:39.877594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 547/1051] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:39 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:40.899976 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:40.900527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:40.907201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:40.907676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:40.908102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:40.908785 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:40.909230 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:40.909649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:41.065223 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:41.073724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cb1a5771-9db1-4454-bc4c-7e500fed4a62 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.178111 Aug 24 14:49:41.074322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 505/1052] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:40 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:42.094554 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:42.095188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:42.102017 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:42.102501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:42.102936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:42.103632 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:42.104086 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:42.104509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:42.241661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:42.242228 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:42.248558 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:42.249035 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:42.249469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:42.250183 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:42.250635 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:42.251053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:42.258277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:42.267598 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2f794308-abf9-4330-9d9a-33f9343a3c77 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.176949 Aug 24 14:49:42.268162 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 548/1053] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:42 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:42.268934 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] HTTP exception thrown: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Request method failure captured: Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 HTTP/1.1 Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfTMTqeki7e1EmF8wpCXJEdeaHADumea9K7qtYIPe0YpLrwznCDwUeCElR8Zm6IihU5oxrYoJ2yIDhQDem6j7tuRhAagsfggjPzNWkWYvHdZpZT0X1aNv7iNxCGn2eJFoQLg1eAo2AwoE0EpFfSY6QBA3guaVJYMvfpTOsNK3wUKrQ Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:49:42.270754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}] Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 556b3a886df740cda4a94e55d2fcc08a Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.273432 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'a1843548-9be2-41a0-a8a7-1f7897083355'} Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:42.274484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.275939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.277662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Returning 404 to user: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:42.277662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bdb769ed-45eb-434a-9427-0519e7088adc tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 404 len: 111 microversion: 2.1 time: 0.035191 Aug 24 14:49:42.277662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 506/1054] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:49:42 2022] DELETE /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 14:49:42.286965 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:42.288444 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: a1843548-9be2-41a0-a8a7-1f7897083355] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:42.294669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:42.305510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:42.305510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:42.305510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:42.305510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:42.305978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:42.311409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] HTTP exception thrown: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Request method failure captured: Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 HTTP/1.1 Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfTMTqeki7e1EmF8wpCXJEdeaHADumea9K7qtYIPe0YpLrwznCDwUeCElR8Zm6IihU5oxrYoJ2yIDhQDem6j7tuRhAagsfggjPzNWkWYvHdZpZT0X1aNv7iNxCGn2eJFoQLg1eAo2AwoE0EpFfSY6QBA3guaVJYMvfpTOsNK3wUKrQ Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:49:42.313164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}] Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 556b3a886df740cda4a94e55d2fcc08a Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.315023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'a1843548-9be2-41a0-a8a7-1f7897083355'} Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:42.315972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. Aug 24 14:49:42.317564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:42.322622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Returning 404 to user: Instance a1843548-9be2-41a0-a8a7-1f7897083355 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:42.322622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3551658f-d8db-4e64-a1b8-0debfdf5a1fd tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355" status: 404 len: 111 microversion: 2.1 time: 0.031725 Aug 24 14:49:42.322622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 549/1055] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:42 2022] GET /compute/v2.1/servers/a1843548-9be2-41a0-a8a7-1f7897083355 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:49:43.295162 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:43.295779 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:43.302795 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:43.303284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:43.303742 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:43.305054 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:43.305718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:43.306173 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:43.461577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:43.471014 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9b738642-b016-40c2-8d7d-bafc06cd2ab0 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.179817 Aug 24 14:49:43.471604 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 507/1056] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:43 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:43.738638 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:43.739243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:43.746660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:43.747145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:43.747576 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:43.748275 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:43.748727 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:43.749148 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:43.763725 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] HTTP exception thrown: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Request method failure captured: Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b HTTP/1.1 Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfTMTqeki7e1EmF8wpCXJEdeaHADumea9K7qtYIPe0YpLrwznCDwUeCElR8Zm6IihU5oxrYoJ2yIDhQDem6j7tuRhAagsfggjPzNWkWYvHdZpZT0X1aNv7iNxCGn2eJFoQLg1eAo2AwoE0EpFfSY6QBA3guaVJYMvfpTOsNK3wUKrQ Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:49:43.765317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}] Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 556b3a886df740cda4a94e55d2fcc08a Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.769509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '5aef7e3a-316c-4347-ae40-5370582a017b'} Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:43.770509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.772190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.774198 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Returning 404 to user: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:43.774198 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b0522626-fb09-45b0-a144-0842c063f0d1 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 404 len: 111 microversion: 2.1 time: 0.032084 Aug 24 14:49:43.774198 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 550/1057] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:49:43 2022] DELETE /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:49:43.776053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:43.776664 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] [instance: 5aef7e3a-316c-4347-ae40-5370582a017b] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:43.783053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:43.783534 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:43.783963 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:43.784648 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:43.785091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:43.785508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:43.799496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] HTTP exception thrown: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Request method failure captured: Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b HTTP/1.1 Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfTMTqeki7e1EmF8wpCXJEdeaHADumea9K7qtYIPe0YpLrwznCDwUeCElR8Zm6IihU5oxrYoJ2yIDhQDem6j7tuRhAagsfggjPzNWkWYvHdZpZT0X1aNv7iNxCGn2eJFoQLg1eAo2AwoE0EpFfSY6QBA3guaVJYMvfpTOsNK3wUKrQ Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:49:43.801163 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2395c1dafb6a4174a7dd095c4809c181"}]}] Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 2395c1dafb6a4174a7dd095c4809c181 Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-252577923 Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 556b3a886df740cda4a94e55d2fcc08a Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeTestJSON-252577923-project Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.802882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '5aef7e3a-316c-4347-ae40-5370582a017b'} Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:49:43.803909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. Aug 24 14:49:43.805915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:49:43.807201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] Returning 404 to user: Instance 5aef7e3a-316c-4347-ae40-5370582a017b could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:49:43.807201 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e0ffa19e-36fc-4dda-92c0-30a047bafd65 tempest-AttachVolumeTestJSON-252577923 tempest-AttachVolumeTestJSON-252577923-project] 10.222.0.65 "GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b" status: 404 len: 111 microversion: 2.1 time: 0.030861 Aug 24 14:49:43.807540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 508/1058] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:43 2022] GET /compute/v2.1/servers/5aef7e3a-316c-4347-ae40-5370582a017b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:49:43.815444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:49:43.815693 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Wed Aug 24 14:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:49:44.494053 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:44.494679 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:44.500756 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:44.501254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:44.501696 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:44.502486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:44.502952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:44.503380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:44.665924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:44.674669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4f497298-4f16-4203-95ac-9ce05da26054 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.184647 Aug 24 14:49:44.677951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 551/1059] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:44 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:45.696645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:45.697345 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:45.705266 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:45.705677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:45.706149 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:45.706871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:45.707326 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:45.707757 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:45.876982 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:45.885772 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4de72567-a0db-4762-8c26-f6d6d8ae32dc tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1754 microversion: 2.1 time: 0.192975 Aug 24 14:49:45.886365 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 509/1060] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:45 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:46.908972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:46.909583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:49:46.917722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:46.918230 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:46.918666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:46.919355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:49:46.919803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:49:46.920362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:49:47.123177 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:49:47.132284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-07cb8d6d-ee05-44c6-9a22-226528958f0c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1757 microversion: 2.1 time: 0.227275 Aug 24 14:49:47.132884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 552/1061] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:49:46 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:49:50.456221 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-59f031f6-b584-4638-a9a1-d829f6767ac2 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Action: 'create', calling method: .version_select at 0x7fbf782c3940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-691557536"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:51.287566 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-59f031f6-b584-4638-a9a1-d829f6767ac2 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.950643 Aug 24 14:49:51.288186 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 510/1062] 10.222.0.65 () {60 vars in 1155 bytes} [Wed Aug 24 14:49:50 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 952 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 14:49:51.301318 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ec7bd115-4af4-4fd4-9699-f07d55c18d7e tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c14bdc0>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:51.363942 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ec7bd115-4af4-4fd4-9699-f07d55c18d7e tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd" status: 200 len: 344 microversion: 2.1 time: 0.053164 Aug 24 14:49:51.363942 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 553/1063] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:49:51 2022] GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:49:52.375627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-33111340-b1a6-472d-9717-1dce61d3f852 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7857e3a0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:52.430754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-33111340-b1a6-472d-9717-1dce61d3f852 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd" status: 200 len: 344 microversion: 2.1 time: 0.059245 Aug 24 14:49:52.431121 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 511/1064] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:49:52 2022] GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:53.445632 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f307fee4-9a97-4180-9a96-912346638304 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c182940>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:53.493348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f307fee4-9a97-4180-9a96-912346638304 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd" status: 200 len: 345 microversion: 2.1 time: 0.052096 Aug 24 14:49:53.494478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 554/1065] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:49:53 2022] GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:53.507743 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-25d5197f-bccd-4b6e-b0b9-8d32e0357179 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Action: 'create', calling method: .version_select at 0x7fbf7857e1f0>, body: {"snapshot": {"volume_id": "f5612aec-affb-453e-ad2f-657c781970bd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-970715243"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:49:53.926349 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-25d5197f-bccd-4b6e-b0b9-8d32e0357179 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.422925 Aug 24 14:49:53.926931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 512/1066] 10.222.0.65 () {60 vars in 1162 bytes} [Wed Aug 24 14:49:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:53.938871 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4827ff45-e5ed-4505-bb00-b75120b75ad9 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c10c430>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:53.985502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4827ff45-e5ed-4505-bb00-b75120b75ad9 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 286 microversion: 2.1 time: 0.051132 Aug 24 14:49:53.986117 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 555/1067] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:49:53 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:53.998053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ee07c542-964a-4e91-89d1-423983ef121d tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf78635af0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:54.033697 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ee07c542-964a-4e91-89d1-423983ef121d tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.040553 Aug 24 14:49:54.034337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 513/1068] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 24 14:49:53 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:54.046083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a10ef57d-6f77-4386-a41a-03bdbe68ec30 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c172a60>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:54.077227 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a10ef57d-6f77-4386-a41a-03bdbe68ec30 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 286 microversion: 2.1 time: 0.035006 Aug 24 14:49:54.078053 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 556/1069] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:49:54 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:55.093810 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-44265b9a-311f-4e9f-af38-d2f5648faac5 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf78394a60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:55.126298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-44265b9a-311f-4e9f-af38-d2f5648faac5 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 286 microversion: 2.1 time: 0.036762 Aug 24 14:49:55.126841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 514/1070] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:49:55 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:56.139673 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a6305241-b2f1-484a-b7aa-4b68015050ce tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c14b310>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:56.169716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a6305241-b2f1-484a-b7aa-4b68015050ce tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 286 microversion: 2.1 time: 0.034455 Aug 24 14:49:56.170314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 557/1071] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:49:56 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:57.179558 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=41 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:57.180336 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=61 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:57.185128 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8e22758f-8c09-44ee-9bc6-8fc85c007b3f tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf78635b80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:57.216234 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8e22758f-8c09-44ee-9bc6-8fc85c007b3f tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 286 microversion: 2.1 time: 0.037288 Aug 24 14:49:57.216802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 515/1072] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:49:57 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:58.225879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:58.226655 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=70 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:58.231534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4ca4bf9e-2265-42db-a2f3-c0dc772dae03 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c10c160>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:58.262414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4ca4bf9e-2265-42db-a2f3-c0dc772dae03 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 286 microversion: 2.1 time: 0.037339 Aug 24 14:49:58.262975 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 558/1073] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:49:58 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:49:59.276493 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ceac8926-6642-4495-bcd8-ca85d367cb2e tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf782c3af0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:49:59.310086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ceac8926-6642-4495-bcd8-ca85d367cb2e tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 286 microversion: 2.1 time: 0.038252 Aug 24 14:49:59.313338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 516/1074] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:49:59 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:00.324651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8a99657d-8d75-42da-bf4d-51a722118ad9 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c14baf0>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:00.356644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8a99657d-8d75-42da-bf4d-51a722118ad9 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 287 microversion: 2.1 time: 0.037297 Aug 24 14:50:00.357237 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 559/1075] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:50:00 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:00.370756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-87039628-bacb-4868-874d-f7c2bb0ecd2a tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7857e280>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:00.536407 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-87039628-bacb-4868-874d-f7c2bb0ecd2a tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 202 len: 0 microversion: 2.1 time: 0.170639 Aug 24 14:50:00.537015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 517/1076] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Aug 24 14:50:00 2022] DELETE /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:50:00.546081 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ad230b64-2e16-4f0f-89e3-87d85e7ba8e0 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c217d30>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:00.577764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ad230b64-2e16-4f0f-89e3-87d85e7ba8e0 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 200 len: 286 microversion: 2.1 time: 0.036027 Aug 24 14:50:00.578379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 560/1077] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:50:00 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:01.592049 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d5afce4-bb90-4704-aa4a-4533c1ec9f2f tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf78635a60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:01.617808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-9d5afce4-bb90-4704-aa4a-4533c1ec9f2f tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] HTTP exception thrown: Snapshot 9378697c-9ae1-42a5-8731-386cf90e050e could not be found. Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d5afce4-bb90-4704-aa4a-4533c1ec9f2f tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Request method failure captured: Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e HTTP/1.1 Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjqO5n4F7TWi7XMgoay70FF5ZRSDPheN9GB8PpSVCvdhUACWVk-vD-WVje5k0Eh1MpYZ82Zuc_CFicNgjDtO6zM1nTs6UDkRdLbROpnEEKRr96ovr-jfQh5a90uz4qPcd05VLa0t0gyBcWB_BGIp4rSmgaA1774FPdCBMtqifSnH_MQ Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 7653b27c868d484785d929372661ae16 Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:50:01.620084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7653b27c868d484785d929372661ae16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7653b27c868d484785d929372661ae16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7653b27c868d484785d929372661ae16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7653b27c868d484785d929372661ae16"}]}] Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 7653b27c868d484785d929372661ae16 Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesSnapshotsTestJSON-1067472284-project Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: a9d2248d8d364c1ca8147d1ff93a01aa Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1067472284-project Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Snapshot 9378697c-9ae1-42a5-8731-386cf90e050e could not be found. Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '9378697c-9ae1-42a5-8731-386cf90e050e'} Aug 24 14:50:01.621781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9378697c-9ae1-42a5-8731-386cf90e050e could not be found. (HTTP 404) (Request-ID: req-e6661783-7563-4701-a244-7d8b7f0c9ac3) Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:01.622702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:50:01.623879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9378697c-9ae1-42a5-8731-386cf90e050e could not be found. Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 14:50:01.625158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9378697c-9ae1-42a5-8731-386cf90e050e could not be found. Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9378697c-9ae1-42a5-8731-386cf90e050e could not be found. Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d5afce4-bb90-4704-aa4a-4533c1ec9f2f tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Returning 404 to user: Snapshot 9378697c-9ae1-42a5-8731-386cf90e050e could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:01.626622 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9d5afce4-bb90-4704-aa4a-4533c1ec9f2f tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e" status: 404 len: 111 microversion: 2.1 time: 0.034852 Aug 24 14:50:01.627489 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 518/1078] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 14:50:01 2022] GET /compute/v2.1/os-snapshots/9378697c-9ae1-42a5-8731-386cf90e050e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:50:01.631922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bc779982-0928-4ccc-9927-ac2bffd578e5 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c19cb80>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:01.862009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-bc779982-0928-4ccc-9927-ac2bffd578e5 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd" status: 202 len: 0 microversion: 2.1 time: 0.235042 Aug 24 14:50:01.864107 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 561/1079] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:50:01 2022] DELETE /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:50:01.871733 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-1f814779-8840-4fad-8caa-c9bb371c5b11 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf782f8a60>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:01.920083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-1f814779-8840-4fad-8caa-c9bb371c5b11 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd" status: 200 len: 344 microversion: 2.1 time: 0.052742 Aug 24 14:50:01.921087 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 519/1080] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:50:01 2022] GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:02.935538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-aecae735-beed-4f40-9161-b2e18f88bd5d tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c182550>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:02.962682 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-aecae735-beed-4f40-9161-b2e18f88bd5d tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] HTTP exception thrown: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-aecae735-beed-4f40-9161-b2e18f88bd5d tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Request method failure captured: Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd HTTP/1.1 Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjqO5n4F7TWi7XMgoay70FF5ZRSDPheN9GB8PpSVCvdhUACWVk-vD-WVje5k0Eh1MpYZ82Zuc_CFicNgjDtO6zM1nTs6UDkRdLbROpnEEKRr96ovr-jfQh5a90uz4qPcd05VLa0t0gyBcWB_BGIp4rSmgaA1774FPdCBMtqifSnH_MQ Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 7653b27c868d484785d929372661ae16 Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:50:02.965314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7653b27c868d484785d929372661ae16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7653b27c868d484785d929372661ae16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7653b27c868d484785d929372661ae16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7653b27c868d484785d929372661ae16"}]}] Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 7653b27c868d484785d929372661ae16 Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-VolumesSnapshotsTestJSON-1067472284-project Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: a9d2248d8d364c1ca8147d1ff93a01aa Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1067472284-project Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'f5612aec-affb-453e-ad2f-657c781970bd'} Aug 24 14:50:02.967129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. (HTTP 404) (Request-ID: req-c86d17e2-6744-457c-b51e-e0c6607a3c90) Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:02.968258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:50:02.969660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:50:02.971054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-aecae735-beed-4f40-9161-b2e18f88bd5d tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Returning 404 to user: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-aecae735-beed-4f40-9161-b2e18f88bd5d tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd" status: 404 len: 109 microversion: 2.1 time: 0.036456 Aug 24 14:50:02.972538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 562/1081] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:50:02 2022] GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:50:02.982528 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c2fef733-f83e-4387-b4ca-c57906623e39 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf78635430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:03.010603 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-c2fef733-f83e-4387-b4ca-c57906623e39 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] HTTP exception thrown: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c2fef733-f83e-4387-b4ca-c57906623e39 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Request method failure captured: Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd HTTP/1.1 Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjqO5n4F7TWi7XMgoay70FF5ZRSDPheN9GB8PpSVCvdhUACWVk-vD-WVje5k0Eh1MpYZ82Zuc_CFicNgjDtO6zM1nTs6UDkRdLbROpnEEKRr96ovr-jfQh5a90uz4qPcd05VLa0t0gyBcWB_BGIp4rSmgaA1774FPdCBMtqifSnH_MQ Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 7653b27c868d484785d929372661ae16 Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:50:03.013538 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7653b27c868d484785d929372661ae16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7653b27c868d484785d929372661ae16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7653b27c868d484785d929372661ae16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7653b27c868d484785d929372661ae16"}]}] Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 7653b27c868d484785d929372661ae16 Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-VolumesSnapshotsTestJSON-1067472284-project Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: a9d2248d8d364c1ca8147d1ff93a01aa Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1067472284-project Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'f5612aec-affb-453e-ad2f-657c781970bd'} Aug 24 14:50:03.015713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. (HTTP 404) (Request-ID: req-ae59e178-47c0-4d47-b67b-6486a324e660) Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:03.016638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 14:50:03.018362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 14:50:03.019927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c2fef733-f83e-4387-b4ca-c57906623e39 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Returning 404 to user: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:03.021337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c2fef733-f83e-4387-b4ca-c57906623e39 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd" status: 404 len: 109 microversion: 2.1 time: 0.037895 Aug 24 14:50:03.022354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 520/1082] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:50:02 2022] DELETE /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:50:03.026792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d4f8840b-8b8e-4646-9ec8-f0fa0094b173 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Calling method '.version_select at 0x7fbf7c14b670>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:03.054910 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-d4f8840b-8b8e-4646-9ec8-f0fa0094b173 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] HTTP exception thrown: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d4f8840b-8b8e-4646-9ec8-f0fa0094b173 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Request method failure captured: Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd HTTP/1.1 Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjqO5n4F7TWi7XMgoay70FF5ZRSDPheN9GB8PpSVCvdhUACWVk-vD-WVje5k0Eh1MpYZ82Zuc_CFicNgjDtO6zM1nTs6UDkRdLbROpnEEKRr96ovr-jfQh5a90uz4qPcd05VLa0t0gyBcWB_BGIp4rSmgaA1774FPdCBMtqifSnH_MQ Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 7653b27c868d484785d929372661ae16 Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:50:03.056879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7653b27c868d484785d929372661ae16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7653b27c868d484785d929372661ae16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7653b27c868d484785d929372661ae16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7653b27c868d484785d929372661ae16"}]}] Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 7653b27c868d484785d929372661ae16 Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1067472284 Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-VolumesSnapshotsTestJSON-1067472284-project Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: a9d2248d8d364c1ca8147d1ff93a01aa Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1067472284-project Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'f5612aec-affb-453e-ad2f-657c781970bd'} Aug 24 14:50:03.058954 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. (HTTP 404) (Request-ID: req-e1cade47-0793-408e-93c9-8eb55950d970) Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:03.062931 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 14:50:03.064277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 14:50:03.066197 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d4f8840b-8b8e-4646-9ec8-f0fa0094b173 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] Returning 404 to user: Volume f5612aec-affb-453e-ad2f-657c781970bd could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d4f8840b-8b8e-4646-9ec8-f0fa0094b173 tempest-VolumesSnapshotsTestJSON-1067472284 tempest-VolumesSnapshotsTestJSON-1067472284-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd" status: 404 len: 109 microversion: 2.1 time: 0.038431 Aug 24 14:50:03.067574 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 563/1083] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 14:50:03 2022] GET /compute/v2.1/os-volumes/f5612aec-affb-453e-ad2f-657c781970bd => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:50:20.984993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:20.987250 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:20.993474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:20.993993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:20.994577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:20.995284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:20.995741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:20.996267 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.028345 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-01e16f75-0f6c-4a10-bb2a-4e7d106ac646 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048469 Aug 24 14:50:21.035569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 521/1084] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 14:50:20 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:21.097150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:21.097728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:21.104792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.105460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.105984 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.106959 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.107409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.107839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.133660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:50:21.528989 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a34a18ad-68e9-40c4-9201-60feb2bc578b tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "DELETE /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 204 len: 0 microversion: 2.20 time: 0.436387 Aug 24 14:50:21.529595 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 564/1085] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 24 14:50:21 2022] DELETE /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:50:21.538227 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:21.538855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:21.546152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.548288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.548288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.548288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:21.548288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:21.548878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:21.685348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:21.693920 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:21.695403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:21.696580 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-488a6d0b-a746-44f2-902a-f027fd87d77a tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.162426 Aug 24 14:50:21.697192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 522/1086] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:21 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:50:22.721304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:22.722168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:22.729675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:22.730277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:22.730923 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:22.731721 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:22.732238 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:22.732691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:23.124492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:23.133776 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:23.135310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:23.136685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ad9ca657-1b65-4545-9798-2a19b727c6f0 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.419732 Aug 24 14:50:23.138032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 565/1087] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:22 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 14:50:24.161178 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:24.162343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:24.172133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:24.172626 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:24.173065 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:24.174415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:24.175166 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:24.175832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:24.329585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:24.338643 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:24.340771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:24.341992 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-00f0eed4-e974-4b38-941d-b327511ab5b7 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1720 microversion: 2.20 time: 0.185233 Aug 24 14:50:24.345902 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 523/1088] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:24 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:25.206729 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-571b6218-4bfb-4830-9f3a-ce8869f26538 req-36719c79-0cd8-4273-a453-21fdad2d2c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a26d59-b1af-4dba-9aaf-bcd473a6b21e", "name": "network-vif-deleted", "tag": "d04c4d4d-11af-427e-8e6f-526632a4a642"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:25.217373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-571b6218-4bfb-4830-9f3a-ce8869f26538 req-36719c79-0cd8-4273-a453-21fdad2d2c93 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.221213 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-571b6218-4bfb-4830-9f3a-ce8869f26538 req-36719c79-0cd8-4273-a453-21fdad2d2c93 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.221213 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-571b6218-4bfb-4830-9f3a-ce8869f26538 req-36719c79-0cd8-4273-a453-21fdad2d2c93 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.232526 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-571b6218-4bfb-4830-9f3a-ce8869f26538 req-36719c79-0cd8-4273-a453-21fdad2d2c93 service nova] Creating event network-vif-deleted:d04c4d4d-11af-427e-8e6f-526632a4a642 for instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e on hv-cinder-75671 Aug 24 14:50:25.237918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-571b6218-4bfb-4830-9f3a-ce8869f26538 req-36719c79-0cd8-4273-a453-21fdad2d2c93 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224074 Aug 24 14:50:25.238640 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 566/1089] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:25.369529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:25.370380 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:25.377680 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.378884 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.379507 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.380322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.380691 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.381147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.431653 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:25.432446 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:25.439671 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:25.439671 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lazy-loading 'fault' on Instance uuid 61a26d59-b1af-4dba-9aaf-bcd473a6b21e {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:50:25.493545 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:25.505482 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:25.507716 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbdf19910c234794b8aeb480dba50d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25aaf7039f994f4a83bf8ce6db68f3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:25.508528 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-10dbb116-abd9-4ccd-bed5-b74da7dd8532 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 200 len: 1370 microversion: 2.20 time: 0.145624 Aug 24 14:50:25.509176 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 524/1090] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:25 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 14:50:26.535416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:26.536111 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:26.542425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:26.543411 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:26.544107 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.545007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:26.545486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:26.545964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:26.565033 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] HTTP exception thrown: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Request method failure captured: Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e HTTP/1.1 Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfLNPd_3oFfbsaxfFTOk1z6OyVAy2ab0CnmENfb-n30XdcQa5d3DAspbQGlS9BrWkm1uWIzV893zqdtSO5gsZoU2V6mplqPGt2s67fFTLEa4-eb8GPrTVg_OUrC4n_-Z2bEfRZ-6ZgV0vwIJ_V-q7kom2jwz0Ih2o7mmscU5wu_Tgo Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:50:26.566761 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}] Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: fbdf19910c234794b8aeb480dba50d85 Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:26.568898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '61a26d59-b1af-4dba-9aaf-bcd473a6b21e'} Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:26.569803 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:26.571365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:26.572667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Returning 404 to user: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:26.572667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-051270a0-1b49-4cef-8800-e0e906b2bcda tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 404 len: 111 microversion: 2.20 time: 0.037560 Aug 24 14:50:26.572667 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 567/1091] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:26 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:50:26.577740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6226c515-a079-41a7-b5d4-0464903a9623 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '.version_select at 0x7fbf783a0ee0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:26.639408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6226c515-a079-41a7-b5d4-0464903a9623 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640105388" status: 204 len: 0 microversion: 2.20 time: 0.065776 Aug 24 14:50:26.640122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 525/1092] 10.222.0.65 () {60 vars in 1259 bytes} [Wed Aug 24 14:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640105388 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 14:50:29.010149 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:29.010684 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:29.018403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:29.027272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:29.027272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:29.027272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:29.027272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:29.027964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:29.039940 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] HTTP exception thrown: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Request method failure captured: Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e HTTP/1.1 Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfLNPd_3oFfbsaxfFTOk1z6OyVAy2ab0CnmENfb-n30XdcQa5d3DAspbQGlS9BrWkm1uWIzV893zqdtSO5gsZoU2V6mplqPGt2s67fFTLEa4-eb8GPrTVg_OUrC4n_-Z2bEfRZ-6ZgV0vwIJ_V-q7kom2jwz0Ih2o7mmscU5wu_Tgo Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:50:29.041512 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}] Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: fbdf19910c234794b8aeb480dba50d85 Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.043236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '61a26d59-b1af-4dba-9aaf-bcd473a6b21e'} Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:29.044098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.045920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.047335 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Returning 404 to user: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:29.047335 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-58a545c5-6e32-4035-a789-1401f22cf555 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "DELETE /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 404 len: 111 microversion: 2.20 time: 0.036793 Aug 24 14:50:29.047335 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 568/1093] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 24 14:50:29 2022] DELETE /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:50:29.051749 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:29.052361 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 61a26d59-b1af-4dba-9aaf-bcd473a6b21e] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:29.059955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:29.060441 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:29.065066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:29.065066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:29.065066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:29.065066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:29.079248 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] HTTP exception thrown: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Request method failure captured: Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e HTTP/1.1 Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfLNPd_3oFfbsaxfFTOk1z6OyVAy2ab0CnmENfb-n30XdcQa5d3DAspbQGlS9BrWkm1uWIzV893zqdtSO5gsZoU2V6mplqPGt2s67fFTLEa4-eb8GPrTVg_OUrC4n_-Z2bEfRZ-6ZgV0vwIJ_V-q7kom2jwz0Ih2o7mmscU5wu_Tgo Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:50:29.080818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}] Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: fbdf19910c234794b8aeb480dba50d85 Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.082484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '61a26d59-b1af-4dba-9aaf-bcd473a6b21e'} Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:29.083385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. Aug 24 14:50:29.085036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:29.086398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Returning 404 to user: Instance 61a26d59-b1af-4dba-9aaf-bcd473a6b21e could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:29.086398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8d625441-97de-409c-a5c9-34ea9aa213f2 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e" status: 404 len: 111 microversion: 2.20 time: 0.034398 Aug 24 14:50:29.086398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 526/1094] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:29 2022] GET /compute/v2.1/servers/61a26d59-b1af-4dba-9aaf-bcd473a6b21e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:50:30.540259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:30.540772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:30.547774 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:30.548262 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:30.548698 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:30.549393 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:30.549949 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:30.550390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:30.565202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] HTTP exception thrown: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Request method failure captured: Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 HTTP/1.1 Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjfLNPd_3oFfbsaxfFTOk1z6OyVAy2ab0CnmENfb-n30XdcQa5d3DAspbQGlS9BrWkm1uWIzV893zqdtSO5gsZoU2V6mplqPGt2s67fFTLEa4-eb8GPrTVg_OUrC4n_-Z2bEfRZ-6ZgV0vwIJ_V-q7kom2jwz0Ih2o7mmscU5wu_Tgo Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:50:30.567009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}] Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: fbdf19910c234794b8aeb480dba50d85 Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.568964 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '687c842a-2354-49c5-9c12-165babf4a0d6'} Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:30.570141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.571646 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.573543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Returning 404 to user: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:30.573543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-a837c645-70ef-4765-8dce-9eb3e381e301 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "DELETE /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 404 len: 111 microversion: 2.20 time: 0.032217 Aug 24 14:50:30.573543 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 569/1095] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 24 14:50:30 2022] DELETE /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:50:30.577645 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:30.578286 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] [instance: 687c842a-2354-49c5-9c12-165babf4a0d6] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:30.584939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:30.585427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:30.586180 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:30.586580 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:30.587028 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:30.587448 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:30.602510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] HTTP exception thrown: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Request method failure captured: Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 HTTP/1.1 Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjfLNPd_3oFfbsaxfFTOk1z6OyVAy2ab0CnmENfb-n30XdcQa5d3DAspbQGlS9BrWkm1uWIzV893zqdtSO5gsZoU2V6mplqPGt2s67fFTLEa4-eb8GPrTVg_OUrC4n_-Z2bEfRZ-6ZgV0vwIJ_V-q7kom2jwz0Ih2o7mmscU5wu_Tgo Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:50:30.604105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25aaf7039f994f4a83bf8ce6db68f3a1"}]}] Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 25aaf7039f994f4a83bf8ce6db68f3a1 Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-254501607 Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: fbdf19910c234794b8aeb480dba50d85 Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeShelveTestJSON-254501607-project Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.610654 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '687c842a-2354-49c5-9c12-165babf4a0d6'} Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:30.611600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. Aug 24 14:50:30.613144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:50:30.615147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] Returning 404 to user: Instance 687c842a-2354-49c5-9c12-165babf4a0d6 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:30.615147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ad02f392-926b-48dc-9fc4-11e43a9e9e63 tempest-AttachVolumeShelveTestJSON-254501607 tempest-AttachVolumeShelveTestJSON-254501607-project] 10.222.0.65 "GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6" status: 404 len: 111 microversion: 2.20 time: 0.032645 Aug 24 14:50:30.615147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 527/1096] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 14:50:30 2022] GET /compute/v2.1/servers/687c842a-2354-49c5-9c12-165babf4a0d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:50:42.066042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:42.072298 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:42.072298 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:42.072298 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:42.074263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-029cd0cb-b1c9-4fe1-ac02-974399fc0633 req-72f6ea75-8e61-438f-9d22-aeb1e9ec1040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599967fc-b96a-4a4f-af19-c62a990493cd", "tag": "31ab6709-e979-4e0b-94f0-4467aab2487c"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:42.077285 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.078021 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.078640 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.079358 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.079809 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.080237 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.085093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:42.093509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=30 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:42.101297 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-029cd0cb-b1c9-4fe1-ac02-974399fc0633 req-72f6ea75-8e61-438f-9d22-aeb1e9ec1040 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.102193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-029cd0cb-b1c9-4fe1-ac02-974399fc0633 req-72f6ea75-8e61-438f-9d22-aeb1e9ec1040 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.102969 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-029cd0cb-b1c9-4fe1-ac02-974399fc0633 req-72f6ea75-8e61-438f-9d22-aeb1e9ec1040 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.108630 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:50:42.123887 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-029cd0cb-b1c9-4fe1-ac02-974399fc0633 req-72f6ea75-8e61-438f-9d22-aeb1e9ec1040 service nova] Creating event network-changed:31ab6709-e979-4e0b-94f0-4467aab2487c for instance 599967fc-b96a-4a4f-af19-c62a990493cd on hv-cinder-75671 Aug 24 14:50:42.131395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-029cd0cb-b1c9-4fe1-ac02-974399fc0633 req-72f6ea75-8e61-438f-9d22-aeb1e9ec1040 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061978 Aug 24 14:50:42.132176 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 528/1097] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:50:42.517284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-80975ff6-357c-4499-8022-3f777097b882 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "DELETE /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 204 len: 0 microversion: 2.1 time: 0.455041 Aug 24 14:50:42.518443 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 570/1098] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:50:42 2022] DELETE /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:50:42.532117 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:42.532824 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:42.540210 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.540793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.541460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.542329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:42.542783 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:42.543382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:42.696167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:42.705553 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d43f28e5-80e1-4d13-8f40-a5ac7bf05024 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1578 microversion: 2.1 time: 0.177842 Aug 24 14:50:42.706806 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 529/1099] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:42 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:43.729119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:43.730651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:43.738691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:43.739021 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:43.739672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:43.740380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:43.740998 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:43.741596 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:43.891301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:43.899125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-9afbcd68-fea5-49df-9f1c-8dfa766a4bc9 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1578 microversion: 2.1 time: 0.174578 Aug 24 14:50:43.899676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 571/1100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:43 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:44.921369 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:44.921949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:44.928280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:44.928754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:44.929186 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:44.929915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:44.930371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:44.930791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:45.068038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:45.076500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b4645913-5ade-4587-9aef-e03583b2aebb tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1460 microversion: 2.1 time: 0.159940 Aug 24 14:50:45.077073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 530/1101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:44 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:46.098760 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:46.099363 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:46.106933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:46.107422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:46.107856 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:46.108548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:46.108998 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:46.109419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:46.260604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:46.273265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1598e177-7406-4876-98e1-61f11d2a7d2d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1460 microversion: 2.1 time: 0.178559 Aug 24 14:50:46.273930 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 572/1102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:46 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1460 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:47.295300 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:47.296071 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:47.305648 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:47.306152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:47.306581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:47.307269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:47.307761 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:47.308440 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:47.449987 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:47.457851 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a923712d-a11e-4cf5-96dd-b13a8e6dc6b8 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1460 microversion: 2.1 time: 0.166775 Aug 24 14:50:47.458460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 531/1103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:47 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1460 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:48.480611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:48.481423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:48.488254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:48.488881 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:48.489686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:48.500288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:48.500288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:48.500288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:48.668488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:48.685943 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-30c3402b-267d-49b8-a871-54764e966ab5 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1460 microversion: 2.1 time: 0.209476 Aug 24 14:50:48.690537 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 573/1104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:48 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1460 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:49.212956 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-701a3952-025d-465c-8bd1-74b672501759 req-e9a2325b-6158-4b3f-96e1-090e406c226c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599967fc-b96a-4a4f-af19-c62a990493cd", "name": "network-vif-deleted", "tag": "31ab6709-e979-4e0b-94f0-4467aab2487c"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:49.230475 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-701a3952-025d-465c-8bd1-74b672501759 req-e9a2325b-6158-4b3f-96e1-090e406c226c service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:49.230964 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-701a3952-025d-465c-8bd1-74b672501759 req-e9a2325b-6158-4b3f-96e1-090e406c226c service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:49.231399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-701a3952-025d-465c-8bd1-74b672501759 req-e9a2325b-6158-4b3f-96e1-090e406c226c service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:49.243764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-701a3952-025d-465c-8bd1-74b672501759 req-e9a2325b-6158-4b3f-96e1-090e406c226c service nova] Creating event network-vif-deleted:31ab6709-e979-4e0b-94f0-4467aab2487c for instance 599967fc-b96a-4a4f-af19-c62a990493cd on hv-cinder-75671 Aug 24 14:50:49.250851 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-701a3952-025d-465c-8bd1-74b672501759 req-e9a2325b-6158-4b3f-96e1-090e406c226c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041096 Aug 24 14:50:49.251840 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 532/1105] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:49.720423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:49.721139 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:49.727917 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:49.728403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:49.728905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:49.730243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:49.730783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:49.731268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:49.812339 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:49.826200 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8d9c1e6a-2e04-4b16-8708-3454eb9574ff tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1225 microversion: 2.1 time: 0.109306 Aug 24 14:50:49.827249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 574/1106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:49 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:50:50.852064 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:50.852739 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:50.859151 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:50.859640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:50.860066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:50.860781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:50.861295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:50.861836 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:50.893742 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:50.894233 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:50.894660 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:50.895096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lazy-loading 'fault' on Instance uuid 599967fc-b96a-4a4f-af19-c62a990493cd {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:50:50.957769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:50.969378 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2a5f7ee3-8df6-4906-b4bc-c2ab1c56464e tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 200 len: 1230 microversion: 2.1 time: 0.122372 Aug 24 14:50:50.970117 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 533/1107] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:50 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:51.997884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:51.998822 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 599967fc-b96a-4a4f-af19-c62a990493cd] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:52.005887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:52.006422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:52.006916 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:52.007540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:52.008036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:52.008404 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:52.022173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] HTTP exception thrown: Instance 599967fc-b96a-4a4f-af19-c62a990493cd could not be found. Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Request method failure captured: Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd HTTP/1.1 Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjgy-gwDpOcTh1HfcjkOUNXHwPeO0sEKmQosjumT3Zr1YIFvz9GZwk1IS4raEBztBs0zkvwXE6HuS0zblJSoQ-FN-dKZHbc54EIFSrCFLYKPxy80WP_KoXagzXMoDFLpnjucPVAsdiaYFH6AoIv7X_qXAMxJuEEkqYZuaQ4_ir-yvWg Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:50:52.023851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}] Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 3b7c54ebd95f4b3eb396982d75615f23 Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 599967fc-b96a-4a4f-af19-c62a990493cd could not be found. Aug 24 14:50:52.025540 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '599967fc-b96a-4a4f-af19-c62a990493cd'} Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599967fc-b96a-4a4f-af19-c62a990493cd could not be found. Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:52.026505 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599967fc-b96a-4a4f-af19-c62a990493cd could not be found. Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599967fc-b96a-4a4f-af19-c62a990493cd could not be found. Aug 24 14:50:52.028168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:52.029541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Returning 404 to user: Instance 599967fc-b96a-4a4f-af19-c62a990493cd could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:52.029541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1d2e00d7-4fa3-412a-8b29-0db46e535910 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd" status: 404 len: 111 microversion: 2.1 time: 0.033852 Aug 24 14:50:52.029541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 575/1108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:51 2022] GET /compute/v2.1/servers/599967fc-b96a-4a4f-af19-c62a990493cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:50:55.730619 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:55.731530 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:55.733684 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-9246d107-5c43-46da-a690-053709e60323 req-9cc0ab9e-913a-4978-9c5a-bb67d0232d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766832e0-abd0-4e53-9f72-40b0a5456b9f", "tag": "6aebd7fb-4731-46dc-b25e-7890dafadc78"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:55.738608 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:55.739614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:55.740271 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:55.741391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:55.742135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:55.742879 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:55.746972 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-9246d107-5c43-46da-a690-053709e60323 req-9cc0ab9e-913a-4978-9c5a-bb67d0232d2a service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:55.747852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-9246d107-5c43-46da-a690-053709e60323 req-9cc0ab9e-913a-4978-9c5a-bb67d0232d2a service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:55.748645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-9246d107-5c43-46da-a690-053709e60323 req-9cc0ab9e-913a-4978-9c5a-bb67d0232d2a service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:55.763270 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-9246d107-5c43-46da-a690-053709e60323 req-9cc0ab9e-913a-4978-9c5a-bb67d0232d2a service nova] Creating event network-changed:6aebd7fb-4731-46dc-b25e-7890dafadc78 for instance 766832e0-abd0-4e53-9f72-40b0a5456b9f on hv-cinder-75671 Aug 24 14:50:55.769261 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-9246d107-5c43-46da-a690-053709e60323 req-9cc0ab9e-913a-4978-9c5a-bb67d0232d2a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041850 Aug 24 14:50:55.773335 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 576/1109] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:55.789401 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Going to try to terminate instance {{(pid=132892) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:50:56.212295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e16abbac-1120-4b38-a750-b0309446687b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "DELETE /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 204 len: 0 microversion: 2.1 time: 0.482882 Aug 24 14:50:56.212295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 534/1110] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:50:55 2022] DELETE /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:50:56.219764 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:56.220548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:56.228303 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:56.230260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:56.231129 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:56.232094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:56.232873 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:56.233542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:56.450491 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:56.459007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3d28b7d2-8882-4186-943a-35db5485f2d4 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1579 microversion: 2.1 time: 0.243883 Aug 24 14:50:56.474220 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 577/1111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:56 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1579 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:57.485668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:57.490555 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:57.494506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:57.495444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:57.495998 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:57.496742 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:57.497278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:57.497672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:57.681584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:57.690687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f5745226-1897-4c91-b3d0-0bc9127a0401 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1460 microversion: 2.1 time: 0.211590 Aug 24 14:50:57.691585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 535/1112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:57 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1460 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:57.924661 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-c6e5a6e9-5904-4d6a-ba2d-5b5faf5721b9 req-01ff0ee8-783f-44f8-b49b-6af18f128721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766832e0-abd0-4e53-9f72-40b0a5456b9f", "name": "network-vif-deleted", "tag": "6aebd7fb-4731-46dc-b25e-7890dafadc78"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:50:57.937441 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c6e5a6e9-5904-4d6a-ba2d-5b5faf5721b9 req-01ff0ee8-783f-44f8-b49b-6af18f128721 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:57.938401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c6e5a6e9-5904-4d6a-ba2d-5b5faf5721b9 req-01ff0ee8-783f-44f8-b49b-6af18f128721 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:57.938869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c6e5a6e9-5904-4d6a-ba2d-5b5faf5721b9 req-01ff0ee8-783f-44f8-b49b-6af18f128721 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:57.951355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-c6e5a6e9-5904-4d6a-ba2d-5b5faf5721b9 req-01ff0ee8-783f-44f8-b49b-6af18f128721 service nova] Creating event network-vif-deleted:6aebd7fb-4731-46dc-b25e-7890dafadc78 for instance 766832e0-abd0-4e53-9f72-40b0a5456b9f on hv-cinder-75671 Aug 24 14:50:57.956767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-c6e5a6e9-5904-4d6a-ba2d-5b5faf5721b9 req-01ff0ee8-783f-44f8-b49b-6af18f128721 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035616 Aug 24 14:50:57.957591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 578/1113] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:50:58.724185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:58.725094 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:58.733462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:58.734278 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:58.734927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:58.735931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:58.736717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:58.737403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:58.779727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:58.780518 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:58.780943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:58.781385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lazy-loading 'fault' on Instance uuid 766832e0-abd0-4e53-9f72-40b0a5456b9f {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:50:58.825252 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7c54ebd95f4b3eb396982d75615f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22a1cf1a07c47a29772e70e4586a77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:50:58.844055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3d5f3541-369b-4548-b8eb-6279d9a8b506 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 200 len: 1230 microversion: 2.1 time: 0.125323 Aug 24 14:50:58.848532 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 536/1114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:58 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 1230 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:50:59.871491 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:50:59.872304 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 766832e0-abd0-4e53-9f72-40b0a5456b9f] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:50:59.878897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:59.884134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:59.884134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:59.884134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:50:59.884134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:50:59.884775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:50:59.895810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] HTTP exception thrown: Instance 766832e0-abd0-4e53-9f72-40b0a5456b9f could not be found. Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Request method failure captured: Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f HTTP/1.1 Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjgy-gwDpOcTh1HfcjkOUNXHwPeO0sEKmQosjumT3Zr1YIFvz9GZwk1IS4raEBztBs0zkvwXE6HuS0zblJSoQ-FN-dKZHbc54EIFSrCFLYKPxy80WP_KoXagzXMoDFLpnjucPVAsdiaYFH6AoIv7X_qXAMxJuEEkqYZuaQ4_ir-yvWg Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:50:59.897487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}] Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 3b7c54ebd95f4b3eb396982d75615f23 Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 766832e0-abd0-4e53-9f72-40b0a5456b9f could not be found. Aug 24 14:50:59.900593 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '766832e0-abd0-4e53-9f72-40b0a5456b9f'} Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766832e0-abd0-4e53-9f72-40b0a5456b9f could not be found. Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:50:59.902731 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766832e0-abd0-4e53-9f72-40b0a5456b9f could not be found. Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766832e0-abd0-4e53-9f72-40b0a5456b9f could not be found. Aug 24 14:50:59.905296 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:50:59.908669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Returning 404 to user: Instance 766832e0-abd0-4e53-9f72-40b0a5456b9f could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:50:59.908669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3a7cb889-071e-4bf5-a778-e3ab74420b1c tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f" status: 404 len: 111 microversion: 2.1 time: 0.033224 Aug 24 14:50:59.908669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 579/1115] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:50:59 2022] GET /compute/v2.1/servers/766832e0-abd0-4e53-9f72-40b0a5456b9f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:00.515187 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:00.515723 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:00.522329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:00.522818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:00.523265 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:00.523947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:00.524465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:00.524895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:00.539624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] HTTP exception thrown: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Request method failure captured: Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: DELETE /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 HTTP/1.1 Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjgy-gwDpOcTh1HfcjkOUNXHwPeO0sEKmQosjumT3Zr1YIFvz9GZwk1IS4raEBztBs0zkvwXE6HuS0zblJSoQ-FN-dKZHbc54EIFSrCFLYKPxy80WP_KoXagzXMoDFLpnjucPVAsdiaYFH6AoIv7X_qXAMxJuEEkqYZuaQ4_ir-yvWg Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:51:00.541268 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}] Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: 3b7c54ebd95f4b3eb396982d75615f23 Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.543447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '7975e08b-1d91-48ec-a6c1-8f783b911af5'} Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:00.544435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.546147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.547837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Returning 404 to user: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:00.547837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-29145ee8-4197-4cbb-8b75-c89bc080e329 tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 404 len: 111 microversion: 2.1 time: 0.032561 Aug 24 14:51:00.547837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 537/1116] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:51:00 2022] DELETE /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:00.551617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:00.555596 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] [instance: 7975e08b-1d91-48ec-a6c1-8f783b911af5] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:00.559963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:00.560716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:00.561049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:00.561814 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:00.562256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:00.562676 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:00.577266 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] HTTP exception thrown: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Request method failure captured: Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 HTTP/1.1 Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjgy-gwDpOcTh1HfcjkOUNXHwPeO0sEKmQosjumT3Zr1YIFvz9GZwk1IS4raEBztBs0zkvwXE6HuS0zblJSoQ-FN-dKZHbc54EIFSrCFLYKPxy80WP_KoXagzXMoDFLpnjucPVAsdiaYFH6AoIv7X_qXAMxJuEEkqYZuaQ4_ir-yvWg Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:51:00.578815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f22a1cf1a07c47a29772e70e4586a77b"}]}] Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: f22a1cf1a07c47a29772e70e4586a77b Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1250699319 Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 3b7c54ebd95f4b3eb396982d75615f23 Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-TestVolumeBootPattern-1250699319-project Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.580531 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '7975e08b-1d91-48ec-a6c1-8f783b911af5'} Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:00.581383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. Aug 24 14:51:00.582872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:00.584008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Returning 404 to user: Instance 7975e08b-1d91-48ec-a6c1-8f783b911af5 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:00.584008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-bf5bc3fd-5c6b-4de4-bf7f-e6e6caf1ee1b tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5" status: 404 len: 111 microversion: 2.1 time: 0.032570 Aug 24 14:51:00.584008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 580/1117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:00 2022] GET /compute/v2.1/servers/7975e08b-1d91-48ec-a6c1-8f783b911af5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:02.257630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0494fa4e-106e-4a94-bef4-e71b86e46d1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] Calling method '.version_select at 0x7fbf785eb160>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:02.364015 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0494fa4e-106e-4a94-bef4-e71b86e46d1d tempest-TestVolumeBootPattern-1250699319 tempest-TestVolumeBootPattern-1250699319-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-624897609" status: 202 len: 0 microversion: 2.1 time: 0.110631 Aug 24 14:51:02.364628 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 538/1118] 10.222.0.65 () {58 vars in 1260 bytes} [Wed Aug 24 14:51:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-624897609 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 14:51:03.981345 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-44644919"}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:03.982074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:03.994500 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:03.996839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:03.997284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:03.998047 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:03.998508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:03.998924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:04.310933 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.network.security_group_api [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Removing security group d150e1a4-1f98-4f12-9b64-0686890f64dc from port ec8669f1-ee91-4159-b9e1-63f57ffa91f6 Aug 24 14:51:04.998162 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0a18642c-2d1b-4a31-a540-1e8126e751a4 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "POST /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/action" status: 202 len: 0 microversion: 2.1 time: 1.023309 Aug 24 14:51:05.005706 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 581/1119] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:51:03 2022] POST /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/action => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:51:05.011574 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-db5edf2b-113f-4893-b084-12c3dcbf04a1 req-e8d76816-ec3a-45fa-836a-5cdbdd314d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc", "tag": "ec8669f1-ee91-4159-b9e1-63f57ffa91f6"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:05.028106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-db5edf2b-113f-4893-b084-12c3dcbf04a1 req-e8d76816-ec3a-45fa-836a-5cdbdd314d89 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:05.029904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-db5edf2b-113f-4893-b084-12c3dcbf04a1 req-e8d76816-ec3a-45fa-836a-5cdbdd314d89 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:05.029904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-db5edf2b-113f-4893-b084-12c3dcbf04a1 req-e8d76816-ec3a-45fa-836a-5cdbdd314d89 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:05.041131 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-db5edf2b-113f-4893-b084-12c3dcbf04a1 req-e8d76816-ec3a-45fa-836a-5cdbdd314d89 service nova] Creating event network-changed:ec8669f1-ee91-4159-b9e1-63f57ffa91f6 for instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc on hv-cinder-75671 Aug 24 14:51:05.049415 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-db5edf2b-113f-4893-b084-12c3dcbf04a1 req-e8d76816-ec3a-45fa-836a-5cdbdd314d89 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046875 Aug 24 14:51:05.050500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 539/1120] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:07.173639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-d64692af-2c65-4964-b692-86c4463791c0 req-77fee897-0f7e-4cf4-bbfd-b40b2322923e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc", "tag": "ec8669f1-ee91-4159-b9e1-63f57ffa91f6"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:07.177260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:07.179724 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:07.216222 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.216877 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.223801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:07.224799 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.225657 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.228131 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:07.234005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d64692af-2c65-4964-b692-86c4463791c0 req-77fee897-0f7e-4cf4-bbfd-b40b2322923e service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.236863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d64692af-2c65-4964-b692-86c4463791c0 req-77fee897-0f7e-4cf4-bbfd-b40b2322923e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.239863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d64692af-2c65-4964-b692-86c4463791c0 req-77fee897-0f7e-4cf4-bbfd-b40b2322923e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:07.278465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-d64692af-2c65-4964-b692-86c4463791c0 req-77fee897-0f7e-4cf4-bbfd-b40b2322923e service nova] Creating event network-changed:ec8669f1-ee91-4159-b9e1-63f57ffa91f6 for instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc on hv-cinder-75671 Aug 24 14:51:07.296300 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-d64692af-2c65-4964-b692-86c4463791c0 req-77fee897-0f7e-4cf4-bbfd-b40b2322923e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124368 Aug 24 14:51:07.298780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 540/1121] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:07.404329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lazy-loading 'services' on Instance uuid d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:07.649587 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8541353d-2ed8-4722-9703-76f9d4aa4cbf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments/c7a412ea-9894-4f7c-bf87-28f497d9f99e" status: 202 len: 0 microversion: 2.1 time: 0.483664 Aug 24 14:51:07.657109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 582/1122] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:51:07 2022] DELETE /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments/c7a412ea-9894-4f7c-bf87-28f497d9f99e => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:51:07.663255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:07.665661 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:07.673044 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.673627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.674299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:07.675084 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.675639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.676142 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:07.716420 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-11526501-ec50-4d15-9e29-778ff5783695 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058230 Aug 24 14:51:07.716941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 541/1123] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:07 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:51:07.755457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:07.756436 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:07.769583 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.770447 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.772283 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:07.773071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.778024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.778024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:07.800871 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4b237a83-460d-457e-bb42-f109204d0f41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a/ips" status: 200 len: 149 microversion: 2.1 time: 0.053093 Aug 24 14:51:07.801449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 583/1124] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:51:07 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:07.817774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99521866-cb71-40bd-98a8-e60f55cdd515"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:07.821863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:07.835608 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.836528 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.837343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:07.839476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:07.840348 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:07.841096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:08.004465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Invalid volume: volume 99521866-cb71-40bd-98a8-e60f55cdd515 is already attached to instances: a4e58813-5807-452b-ae56-f0aeeb215ac9 Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: POST /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a/os-volume_attachments HTTP/1.1 Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 74 Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:51:08.008053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {"volumeAttachment": {"volumeId": "99521866-cb71-40bd-98a8-e60f55cdd515"}} Aug 24 14:51:08.009715 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Invalid volume: volume 99521866-cb71-40bd-98a8-e60f55cdd515 is already attached to instances: a4e58813-5807-452b-ae56-f0aeeb215ac9 Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'server_id': 'b6050d18-78e2-43dd-8006-bfbb0480d25a', 'body': {'volumeAttachment': {'volumeId': '99521866-cb71-40bd-98a8-e60f55cdd515'}}} Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 99521866-cb71-40bd-98a8-e60f55cdd515 is already attached to instances: a4e58813-5807-452b-ae56-f0aeeb215ac9 Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:08.011185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 99521866-cb71-40bd-98a8-e60f55cdd515 is already attached to instances: a4e58813-5807-452b-ae56-f0aeeb215ac9 Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:08.012880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:08.014438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:08.014438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:08.014438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:08.014438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 99521866-cb71-40bd-98a8-e60f55cdd515 is already attached to instances: a4e58813-5807-452b-ae56-f0aeeb215ac9 Aug 24 14:51:08.014438 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:08.015896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 400 to user: Invalid volume: volume 99521866-cb71-40bd-98a8-e60f55cdd515 is already attached to instances: a4e58813-5807-452b-ae56-f0aeeb215ac9 {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:08.016968 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-90eb41b0-ff0a-427b-981b-b1f4bab97f07 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.207330 Aug 24 14:51:08.018185 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 542/1125] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:51:07 2022] POST /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a/os-volume_attachments => generated 174 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:51:08.032820 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:08.034054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:08.045571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:08.046653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:08.047861 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:08.049288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:08.050392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:08.051385 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:08.099194 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:51:08.544910 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3bd2d82b-3a83-47ff-a2e2-5c84e1cb7552 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 204 len: 0 microversion: 2.1 time: 0.519290 Aug 24 14:51:08.545984 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 584/1126] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:51:08 2022] DELETE /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:51:08.553775 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:08.555263 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:08.563501 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:08.568821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:08.568821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:08.568821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:08.568821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:08.569328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:08.729965 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:08.732461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:08.738838 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:08.739320 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:08.739754 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:08.740783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:08.741606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:08.741990 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:08.749044 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:08.758374 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8514b156-a1fa-4f2f-9f54-15b9f2f80301 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1678 microversion: 2.1 time: 0.207686 Aug 24 14:51:08.759447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 543/1127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:08 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:51:08.788773 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2b1f1060-4247-4984-9358-fb65b2f8a153 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063469 Aug 24 14:51:08.789343 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 585/1128] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:08 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:09.789989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:09.790731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:09.801271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:09.802559 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:09.803076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:09.803748 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:09.803878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:09.804811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:09.805324 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:09.806105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:09.814251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:09.815170 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:09.816010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:09.817142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:09.818303 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:09.818979 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:09.844980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:09.858722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-00339d0b-d070-48ae-b4d7-6eb7d5c44152 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061820 Aug 24 14:51:09.859777 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 586/1129] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:09 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:51:10.002989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:10.019036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-39622665-7397-4888-b5bd-af872eb704bc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1678 microversion: 2.1 time: 0.233786 Aug 24 14:51:10.020273 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 544/1130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:09 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:10.875759 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:10.878184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:10.896495 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:10.897117 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:10.897484 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:10.898707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:10.899453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:10.900288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:10.943051 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e17224aa-f831-446c-abe3-7c1a1b3d2723 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071498 Aug 24 14:51:10.944033 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 587/1131] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:10 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:11.046621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:11.047747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:11.056717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:11.056717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:11.056717 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:11.057454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:11.057454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:11.058214 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:11.250074 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:11.266922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-52474cf1-b7a2-4d0d-88a2-f06377fefd7f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1678 microversion: 2.1 time: 0.230074 Aug 24 14:51:11.283782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 545/1132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:11 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:11.963655 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:11.968187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:11.981566 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:11.982293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:11.983015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:11.983959 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:11.984572 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:11.985168 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:12.029475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-04cc2ba8-2408-4391-b5e1-c3a6acb1d38a tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073235 Aug 24 14:51:12.031265 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 588/1133] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:11 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:12.299354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:12.300168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:12.309069 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:12.309690 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:12.310347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:12.311193 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:12.311758 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:12.312308 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:12.335677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:12.595307 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:12.604618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-810e2051-b481-4c04-b30e-5efb0007c83e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1678 microversion: 2.1 time: 0.309616 Aug 24 14:51:12.605194 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 546/1134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:12 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1678 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:13.043425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:13.045795 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:13.052562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:13.053045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:13.053478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:13.054218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:13.054687 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:13.055085 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:13.089221 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b34c0200-d14a-42f6-81c3-3fa52c4a03cd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050196 Aug 24 14:51:13.089892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 589/1135] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:13 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:13.626773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:13.627385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:13.634691 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:13.635328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:13.635766 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:13.636537 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:13.636918 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:13.637427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:13.784815 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:13.793292 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6518024b-5c8b-4dc4-8b75-e626ac663e35 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1678 microversion: 2.1 time: 0.170363 Aug 24 14:51:13.794012 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 547/1136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:13 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:14.103070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:14.105538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:14.108024 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:14.112751 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:14.113241 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:14.113715 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:14.114467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:14.114921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:14.115374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:14.146991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cf64cc86-edab-47a1-ad89-258756b4e062 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Aug 24 14:51:14.149571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 590/1137] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:14 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:14.819452 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:14.820224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:14.827783 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:14.828636 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:14.828813 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:14.829598 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:14.830209 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:14.830922 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:15.019311 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:15.028299 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a9282fcb-e257-4f12-8297-31d09da4a6fc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1678 microversion: 2.1 time: 0.212892 Aug 24 14:51:15.028895 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 548/1138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:14 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:15.160284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:15.162462 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:15.169488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:15.170012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:15.170456 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:15.171172 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:15.171634 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:15.172058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:15.202350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f65ad9b6-d1ee-48ce-bcdb-761b19d59750 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046563 Aug 24 14:51:15.202920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 591/1139] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:15 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:51:16.050431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:16.051104 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:16.053359 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:16.058101 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:16.058578 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:16.059035 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:16.059733 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:16.060175 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:16.060590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:16.216836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:16.219651 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:16.224914 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:16.228052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:16.228829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:16.229525 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:16.230639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:16.231093 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:16.231514 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:16.240052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e7e6b483-f41e-490c-8192-7f2231dc086a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1678 microversion: 2.1 time: 0.193282 Aug 24 14:51:16.255143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 549/1140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:16 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:16.264630 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1ea7f870-18f0-4cb5-997c-365907610639 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052400 Aug 24 14:51:16.265202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 592/1141] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:16 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:51:16.842724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-d92bc4a1-ae90-4d00-9453-97fda84655c8 req-225f4811-9dc6-424a-baa9-aade3ecca865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6050d18-78e2-43dd-8006-bfbb0480d25a", "name": "network-vif-deleted", "tag": "b16f8165-9a3b-4a2c-b254-8b71c5ae23b3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:16.853102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d92bc4a1-ae90-4d00-9453-97fda84655c8 req-225f4811-9dc6-424a-baa9-aade3ecca865 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:16.854790 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d92bc4a1-ae90-4d00-9453-97fda84655c8 req-225f4811-9dc6-424a-baa9-aade3ecca865 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:16.855221 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-d92bc4a1-ae90-4d00-9453-97fda84655c8 req-225f4811-9dc6-424a-baa9-aade3ecca865 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:16.867974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-d92bc4a1-ae90-4d00-9453-97fda84655c8 req-225f4811-9dc6-424a-baa9-aade3ecca865 service nova] Creating event network-vif-deleted:b16f8165-9a3b-4a2c-b254-8b71c5ae23b3 for instance b6050d18-78e2-43dd-8006-bfbb0480d25a on hv-cinder-75671 Aug 24 14:51:16.874613 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-d92bc4a1-ae90-4d00-9453-97fda84655c8 req-225f4811-9dc6-424a-baa9-aade3ecca865 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037319 Aug 24 14:51:16.875298 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 550/1142] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:17.267045 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:17.267734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:17.274772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:17.275184 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:17.276398 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:17.277310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:17.277908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:17.278477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:17.278705 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:17.281677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:17.288933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:17.289526 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:17.290086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:17.290823 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:17.291317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:17.292114 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:17.328079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e72f2332-ee37-43ed-a872-ec1e0de4a5dd tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055216 Aug 24 14:51:17.328774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 551/1143] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:17 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:51:17.353878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:17.362482 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-5438d494-4911-4fbf-b584-4e7bc1491037 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1612 microversion: 2.1 time: 0.099436 Aug 24 14:51:17.363048 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 593/1144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:17 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1612 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:51:18.340850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:18.343269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:18.350199 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:18.350677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:18.351106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:18.351814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:18.352264 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:18.352674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:18.383457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fbf1fc79-7311-4543-a8e6-682f6b437279 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047164 Aug 24 14:51:18.384198 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 552/1145] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:18 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:18.385557 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:18.386252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:18.393653 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:18.394227 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:18.394698 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:18.395429 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:18.395884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:18.396331 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:18.461027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:18.469236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-36d4cdc4-9cb0-494e-9d37-0ae5037661ff tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1325 microversion: 2.1 time: 0.088928 Aug 24 14:51:18.469818 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 594/1146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:18 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1325 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:51:19.396630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:19.398676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:19.405908 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:19.406391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:19.406914 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:19.407523 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:19.407998 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:19.408475 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:19.439034 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4ce44fc8-281d-4b8d-b7a0-e28f7f198ccf tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046438 Aug 24 14:51:19.439591 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 553/1147] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:19 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:19.490478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:19.491089 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:19.497656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:19.498169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:19.498606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:19.499301 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:19.499758 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:19.500208 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:19.565892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:19.574401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b7c83b04-a231-4cdd-a845-b45eabf021ee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1325 microversion: 2.1 time: 0.087770 Aug 24 14:51:19.574967 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 595/1148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:19 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1325 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:20.455160 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:20.458052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:20.467481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:20.468219 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:20.469017 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:20.469737 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:20.470210 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:20.470636 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:20.502792 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d73b02a2-d186-474d-bf3c-13fae1eb8d27 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052868 Aug 24 14:51:20.503362 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 554/1149] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:20 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:20.597807 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:20.598579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:20.605947 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:20.606362 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:20.606801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:20.607503 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:20.607957 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:20.608380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:20.640806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:20.641375 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:20.641974 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:20.642414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'fault' on Instance uuid b6050d18-78e2-43dd-8006-bfbb0480d25a {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:20.688924 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:20.697102 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-77cb4d5d-b9f7-42f4-b302-8c8350dcfd13 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1330 microversion: 2.1 time: 0.104311 Aug 24 14:51:20.697783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 596/1150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:20 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:21.515860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:21.517937 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:21.524431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:21.524907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:21.525447 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:21.526171 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:21.526611 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:21.527028 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:21.557104 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b8353e5f-06e8-419c-9ae1-8d62134c7d82 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Aug 24 14:51:21.557662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 555/1151] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:21 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:21.720079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:21.720681 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:21.727891 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:21.728868 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:21.729492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:21.730174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:21.730620 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:21.731039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:21.765071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:21.765547 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:21.766082 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:21.766529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'fault' on Instance uuid b6050d18-78e2-43dd-8006-bfbb0480d25a {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:21.812194 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:21.821061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-61ef0775-1df2-4144-9eef-ab3b6a12082f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1330 microversion: 2.1 time: 0.104840 Aug 24 14:51:21.821635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 597/1152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:21 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:22.569410 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:22.571691 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:22.579068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:22.579548 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:22.580001 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:22.580674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:22.581119 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:22.581537 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:22.612122 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e678dc3e-2838-44a0-ae22-a6748abc23a2 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046615 Aug 24 14:51:22.612676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 556/1153] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:22 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:22.848853 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:22.849431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:22.856001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:22.856488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:22.856925 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:22.857628 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:22.858102 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:22.858527 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:22.891224 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:22.891705 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:22.892268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:22.892859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'fault' on Instance uuid b6050d18-78e2-43dd-8006-bfbb0480d25a {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:22.935302 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:22.943205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c92b77a5-938c-498e-b823-c36cd3877a28 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1330 microversion: 2.1 time: 0.098558 Aug 24 14:51:22.943808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 598/1154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:22 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:23.624152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:23.626518 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:23.632903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:23.633393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:23.633836 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:23.634585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:23.635156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:23.635576 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:23.666153 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df34b15d-3e2a-489c-9f21-2292345cfede tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045641 Aug 24 14:51:23.670549 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 557/1155] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:23 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:23.967193 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:23.967838 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:23.974713 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:23.975189 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:23.975617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:23.976308 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:23.976756 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:23.977205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:24.011159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:24.011641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:24.012075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:24.012516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'fault' on Instance uuid b6050d18-78e2-43dd-8006-bfbb0480d25a {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:24.059970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:24.067757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8f51a0f2-d8ba-45fd-bed1-700a1c448ca7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 200 len: 1330 microversion: 2.1 time: 0.105401 Aug 24 14:51:24.068324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 599/1156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:23 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:24.679219 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:24.681900 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:24.689013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:24.689489 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:24.689957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:24.690740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:24.691125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:24.691573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:24.725614 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a5a20211-69be-455b-97bf-bfcb1b7f1d47 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050461 Aug 24 14:51:24.726257 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 558/1157] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:24 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:25.090314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:25.090935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:25.097790 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:25.098292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:25.098725 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:25.099416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:25.099862 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:25.100278 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:25.117966 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a HTTP/1.1 Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:51:25.120007 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:51:25.121846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'b6050d18-78e2-43dd-8006-bfbb0480d25a'} Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:25.122892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:51:25.124516 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:25.126400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:25.126400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-19f4cbc3-08b4-4f18-bb2e-d4c33cbd77ae tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 404 len: 111 microversion: 2.1 time: 0.036061 Aug 24 14:51:25.126400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 600/1158] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:25 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:25.130556 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e328145a-6dc4-413a-889a-8448c15a9443 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '.version_select at 0x7fbf782991f0>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:25.249678 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e328145a-6dc4-413a-889a-8448c15a9443 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142687427" status: 202 len: 0 microversion: 2.1 time: 0.122862 Aug 24 14:51:25.250311 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 559/1159] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 14:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142687427 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:51:25.738452 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:25.741073 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:25.755356 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:25.755757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:25.756196 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:25.756909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:25.757366 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:25.757816 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:25.793981 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-29003200-6f7a-47e5-924b-a78a344cc68b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059429 Aug 24 14:51:25.798691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 601/1160] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:25 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:26.200270 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:26.210905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:26.210905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:26.210905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:26.210905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:26.211561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:26.211561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:26.211561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:26.305733 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'services' on Instance uuid a4e58813-5807-452b-ae56-f0aeeb215ac9 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:26.573838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b2c27f79-f55d-4a7a-8324-7257b592afd1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments/99521866-cb71-40bd-98a8-e60f55cdd515" status: 202 len: 0 microversion: 2.1 time: 0.378694 Aug 24 14:51:26.574663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 560/1161] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:51:26 2022] DELETE /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments/99521866-cb71-40bd-98a8-e60f55cdd515 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:51:26.583131 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:26.589450 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:26.592991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:26.593476 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:26.593939 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:26.594692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:26.595144 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:26.595565 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:26.617901 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=100 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:26.642402 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ca8ad2ba-26c4-4f2e-9387-a7c5f94438b1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052517 Aug 24 14:51:26.642402 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 602/1162] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:26 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:26.807142 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:26.810182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:26.816908 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:26.817404 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:26.817877 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:26.818584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:26.819091 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:26.819522 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:26.852926 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ac9d5be6-2902-48a5-9c80-89ac45be9539 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050487 Aug 24 14:51:26.854367 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 561/1163] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:26 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:27.649608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:27.652064 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:27.658571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:27.659050 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:27.659479 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:27.660169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:27.660616 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:27.661037 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:27.691417 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8201ec67-0801-4004-bf48-8bb1244d1e79 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046066 Aug 24 14:51:27.692187 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 603/1164] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:27 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:27.866138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:27.871224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:27.877161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:27.877649 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:27.878128 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:27.878840 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:27.879326 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:27.879778 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:27.910220 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7dbddbcb-3e3c-44e4-8ee0-664011da2142 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047911 Aug 24 14:51:27.910704 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 562/1165] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:27 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:28.704480 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:28.706680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:28.713958 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:28.714439 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:28.714876 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:28.715564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:28.716010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:28.716424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:28.745991 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-d7e4f64c-1a76-4a2d-b3a7-2cabf59baf5a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Aug 24 14:51:28.746542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 604/1166] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:28 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:28.922476 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:28.924520 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:28.931676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:28.932505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:28.932915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:28.933602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:28.934076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:28.934496 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:28.965092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-18e97cf2-e237-4088-a43e-d6c339afe509 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046587 Aug 24 14:51:28.965647 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 563/1167] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:28 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:29.759561 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:29.761818 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:29.768314 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:29.768788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:29.769219 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:29.773079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:29.773079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:29.773079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:29.801109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-25955cf0-8086-4d9e-995d-617102a4056c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Aug 24 14:51:29.807492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 605/1168] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:29 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:29.977252 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:29.979350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:29.985774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:29.986271 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:29.986703 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:29.987391 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:29.987841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:29.988384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:29.992153 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:30.019076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-94802f4e-ec7a-4578-a307-c411d4873b1b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Aug 24 14:51:30.019664 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 564/1169] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:29 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:30.813617 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:30.816690 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:30.823767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:30.824254 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:30.824890 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:30.825615 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:30.826096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:30.826517 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:30.862142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8b6d52e0-c4ae-4673-aa4e-add708f96705 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052393 Aug 24 14:51:30.863049 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 606/1170] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:30 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:31.031052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:31.033109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:31.040213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.041478 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.042197 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.042903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.043353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.043778 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.074478 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-11a84b0a-f6ed-4134-8046-cfd81d5dc0ff tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047440 Aug 24 14:51:31.075039 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 565/1171] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:31 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:51:31.085639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:31.086383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:31.093781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.094285 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.094836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.095529 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.095974 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.096392 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.363538 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] HTTP exception thrown: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc is not attached to volume c7a412ea-9894-4f7c-bf87-28f497d9f99e Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Request method failure captured: Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments/c7a412ea-9894-4f7c-bf87-28f497d9f99e HTTP/1.1 Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjnGUlDC31huw-JiUo4XUpzrGPKuoMnpwR9xyFUVibP27DZvb7dLEY-U5Cgjts3uCT7aewgD5aYGz4fHGYqvWaD1GpM8T86VGotj-AepKUL_ws-NiFEOpduoZ7NI2-O3v6B_ibhEHJMi83St0FLaz6gBanyQ-CiT8iFTcSzRjF74eh0 Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 1a8ff5bc8c6d4adaac8b73d5dfadfc31 Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-TestMinimumBasicScenario-176696806 Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:51:31.379455 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1a8ff5bc8c6d4adaac8b73d5dfadfc31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1a8ff5bc8c6d4adaac8b73d5dfadfc31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1a8ff5bc8c6d4adaac8b73d5dfadfc31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1a8ff5bc8c6d4adaac8b73d5dfadfc31"}]}] Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-TestMinimumBasicScenario-176696806 Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 1a8ff5bc8c6d4adaac8b73d5dfadfc31 Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-TestMinimumBasicScenario-176696806 Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-TestMinimumBasicScenario-176696806-project Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: cde1ea819e2d47e8b1a8ef5247bc61e0 Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-TestMinimumBasicScenario-176696806-project Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:51:31.380836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc is not attached to volume c7a412ea-9894-4f7c-bf87-28f497d9f99e Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'server_id': 'd6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc', 'id': 'c7a412ea-9894-4f7c-bf87-28f497d9f99e'} Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c7a412ea-9894-4f7c-bf87-28f497d9f99e. Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:31.381629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc is not attached to volume c7a412ea-9894-4f7c-bf87-28f497d9f99e Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc is not attached to volume c7a412ea-9894-4f7c-bf87-28f497d9f99e Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:51:31.383038 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Returning 404 to user: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc is not attached to volume c7a412ea-9894-4f7c-bf87-28f497d9f99e {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:31.384001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-610f9a1f-aeb3-4663-9ad8-555580511428 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments/c7a412ea-9894-4f7c-bf87-28f497d9f99e" status: 404 len: 154 microversion: 2.1 time: 0.298626 Aug 24 14:51:31.384001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 607/1172] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:51:31 2022] DELETE /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc/os-volume_attachments/c7a412ea-9894-4f7c-bf87-28f497d9f99e => generated 154 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:31.875758 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:31.877986 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:31.884282 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.884875 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.885384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.886130 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.886583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.887008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.921004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-24062bf9-b22d-4104-972d-db053965d5ce tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049491 Aug 24 14:51:31.921567 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 566/1173] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:51:31 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:51:31.989281 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:31.989888 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:31.996220 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.996697 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.997128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:31.997857 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:31.998311 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:31.998733 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:32.023880 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:51:32.603271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1f26f6dd-85d1-449d-a78d-4544d4dc38fd tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 204 len: 0 microversion: 2.1 time: 0.617297 Aug 24 14:51:32.604052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 608/1174] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:51:31 2022] DELETE /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:51:32.623728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:32.623728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:32.623728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:32.623728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:32.624859 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:32.624859 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:32.624859 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:32.624859 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:32.762971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:32.770773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0cfcb6ed-4792-4045-9a26-6645a6504e0b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1680 microversion: 2.1 time: 0.162358 Aug 24 14:51:32.771345 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 567/1175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:32 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:32.898193 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:32.898765 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:32.905875 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:32.906361 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:32.906793 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:32.907490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:32.908071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:32.909290 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:32.939914 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:51:33.476639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4fbca7d2-f4cf-4bae-a8d4-36f1abb5f20f tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 204 len: 0 microversion: 2.1 time: 0.582445 Aug 24 14:51:33.477374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 609/1176] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:51:32 2022] DELETE /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 14:51:33.486332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:33.486998 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:33.492937 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:33.493469 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:33.494491 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:33.495204 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:33.495657 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:33.496177 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:33.632425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:33.640557 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ef1f8e9c-228c-4d1a-96d4-01fe63168e8c tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1553 microversion: 2.1 time: 0.158596 Aug 24 14:51:33.641128 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 568/1177] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:33 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:33.794581 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:33.795306 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:33.801324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:33.801832 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:33.802268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:33.802992 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:33.803435 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:33.803850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:33.945141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:33.960642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2e6bc40e-5c71-4a14-9f2f-4842b6a704f5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1680 microversion: 2.1 time: 0.165606 Aug 24 14:51:33.960642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 610/1178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:33 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:34.662923 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:34.663533 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:34.676731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:34.676731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:34.676731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:34.676731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:34.677189 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:34.677189 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:34.818098 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:34.826107 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7a4683cd-df63-4c05-b680-ed5a87d5e5c3 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1553 microversion: 2.1 time: 0.167087 Aug 24 14:51:34.826697 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 569/1179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:34 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:35.148660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:35.149271 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:35.156844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:35.157269 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:35.157700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:35.158413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:35.158869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:35.159349 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:35.301872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:35.311266 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-fa3f4b79-e64b-438a-b7b4-f8fe5649f937 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1680 microversion: 2.1 time: 0.338617 Aug 24 14:51:35.311859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 611/1180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:34 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1680 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:35.848831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:35.849563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:35.857525 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:35.858095 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:35.858540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:35.859235 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:35.859686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:35.860111 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:35.995011 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:36.002687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b635a41f-a932-4bd2-bb97-87be97ed47a8 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1553 microversion: 2.1 time: 0.158012 Aug 24 14:51:36.003248 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 570/1181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:35 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:36.335055 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:36.335884 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:36.345120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:36.345615 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:36.346083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:36.347019 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:36.347850 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:36.348274 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:36.483365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:36.491684 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-82788b79-36b8-4dfa-a5d8-d15d6033256b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1680 microversion: 2.1 time: 0.161426 Aug 24 14:51:36.492263 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 612/1182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:36 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:37.025831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:37.027073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:37.033344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.034216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.042068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.042068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.042068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.042068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.254971 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:37.263240 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ee2770ca-960d-4739-8ccc-fac054296490 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1553 microversion: 2.1 time: 0.242490 Aug 24 14:51:37.263843 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 571/1183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:37 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:37.266765 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-4dbd4c7c-91d8-4151-a40e-6bfccb830c7c req-145dc886-5b03-4477-b16b-8b9ee6200081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc", "name": "network-vif-deleted", "tag": "ec8669f1-ee91-4159-b9e1-63f57ffa91f6"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:37.279975 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-4dbd4c7c-91d8-4151-a40e-6bfccb830c7c req-145dc886-5b03-4477-b16b-8b9ee6200081 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.280548 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-4dbd4c7c-91d8-4151-a40e-6bfccb830c7c req-145dc886-5b03-4477-b16b-8b9ee6200081 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.281042 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-4dbd4c7c-91d8-4151-a40e-6bfccb830c7c req-145dc886-5b03-4477-b16b-8b9ee6200081 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.293841 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-4dbd4c7c-91d8-4151-a40e-6bfccb830c7c req-145dc886-5b03-4477-b16b-8b9ee6200081 service nova] Creating event network-vif-deleted:ec8669f1-ee91-4159-b9e1-63f57ffa91f6 for instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc on hv-cinder-75671 Aug 24 14:51:37.299116 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-4dbd4c7c-91d8-4151-a40e-6bfccb830c7c req-145dc886-5b03-4477-b16b-8b9ee6200081 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045963 Aug 24 14:51:37.299733 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 613/1184] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:51:37.517691 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:37.518612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:37.531419 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.532195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.532639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.533979 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.535090 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.537255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.670861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:37.680595 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c7ca2de8-3e58-426e-a048-e108925201d0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1613 microversion: 2.1 time: 0.168843 Aug 24 14:51:37.681540 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 572/1185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:37 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1613 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:37.771799 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-bfb96c6c-b501-4611-8505-4e2cba1265a9 req-7f1ba113-91e2-499e-b95b-a72400068abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e58813-5807-452b-ae56-f0aeeb215ac9", "name": "network-vif-deleted", "tag": "21285ac6-45a9-46f0-94fd-debd0b98b3ba"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:37.787846 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-bfb96c6c-b501-4611-8505-4e2cba1265a9 req-7f1ba113-91e2-499e-b95b-a72400068abd service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:37.788409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-bfb96c6c-b501-4611-8505-4e2cba1265a9 req-7f1ba113-91e2-499e-b95b-a72400068abd service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:37.788944 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-bfb96c6c-b501-4611-8505-4e2cba1265a9 req-7f1ba113-91e2-499e-b95b-a72400068abd service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:37.802432 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-bfb96c6c-b501-4611-8505-4e2cba1265a9 req-7f1ba113-91e2-499e-b95b-a72400068abd service nova] Creating event network-vif-deleted:21285ac6-45a9-46f0-94fd-debd0b98b3ba for instance a4e58813-5807-452b-ae56-f0aeeb215ac9 on hv-cinder-75671 Aug 24 14:51:37.810501 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-bfb96c6c-b501-4611-8505-4e2cba1265a9 req-7f1ba113-91e2-499e-b95b-a72400068abd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045340 Aug 24 14:51:37.815811 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 614/1186] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:38.288269 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:38.289038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:38.295788 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.296332 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.296777 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.297483 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.298024 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.298454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.331671 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.332153 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.332595 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.333060 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lazy-loading 'fault' on Instance uuid d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:38.378908 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde1ea819e2d47e8b1a8ef5247bc61e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8ff5bc8c6d4adaac8b73d5dfadfc31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:38.387911 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7ce448c7-5a1b-4475-b30a-c5e1233cadbb tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 200 len: 1348 microversion: 2.1 time: 0.103609 Aug 24 14:51:38.388506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 573/1187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:38 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:38.705284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:38.706090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:38.714142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.714142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.714478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.715256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.715738 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.716169 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.751372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:38.751857 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:38.752288 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:38.752768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'fault' on Instance uuid a4e58813-5807-452b-ae56-f0aeeb215ac9 {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:51:38.800982 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:38.809289 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dfbd3f1d-416c-4312-8323-6806e5c0b056 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 200 len: 1332 microversion: 2.1 time: 0.108622 Aug 24 14:51:38.809887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 615/1188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:38 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:39.411511 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:39.412068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] [instance: d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:39.418927 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:39.419398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:39.419827 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:39.420530 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:39.420955 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:39.421371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:39.436107 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] HTTP exception thrown: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc could not be found. Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Request method failure captured: Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc HTTP/1.1 Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjnGUlDC31huw-JiUo4XUpzrGPKuoMnpwR9xyFUVibP27DZvb7dLEY-U5Cgjts3uCT7aewgD5aYGz4fHGYqvWaD1GpM8T86VGotj-AepKUL_ws-NiFEOpduoZ7NI2-O3v6B_ibhEHJMi83St0FLaz6gBanyQ-CiT8iFTcSzRjF74eh0 Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 1a8ff5bc8c6d4adaac8b73d5dfadfc31 Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-TestMinimumBasicScenario-176696806 Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:51:39.437802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1a8ff5bc8c6d4adaac8b73d5dfadfc31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1a8ff5bc8c6d4adaac8b73d5dfadfc31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1a8ff5bc8c6d4adaac8b73d5dfadfc31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1a8ff5bc8c6d4adaac8b73d5dfadfc31"}]}] Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-TestMinimumBasicScenario-176696806 Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 1a8ff5bc8c6d4adaac8b73d5dfadfc31 Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-TestMinimumBasicScenario-176696806 Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-TestMinimumBasicScenario-176696806-project Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: cde1ea819e2d47e8b1a8ef5247bc61e0 Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-TestMinimumBasicScenario-176696806-project Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc could not be found. Aug 24 14:51:39.440727 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'd6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc'} Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc could not be found. Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:39.441732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc could not be found. Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc could not be found. Aug 24 14:51:39.443399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.444806 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Returning 404 to user: Instance d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:39.444806 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-df56c67b-a346-4769-b185-fa592515134b tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc" status: 404 len: 111 microversion: 2.1 time: 0.031776 Aug 24 14:51:39.444806 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 574/1189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:39 2022] GET /compute/v2.1/servers/d6b9cbcf-9a48-42d2-bc65-a6b8efcbbfcc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:39.448749 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c74fd95d-7aaa-4155-b00a-f7d527266768 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] Calling method '.version_select at 0x7fbf7c10c670>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:39.557420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c74fd95d-7aaa-4155-b00a-f7d527266768 tempest-TestMinimumBasicScenario-176696806 tempest-TestMinimumBasicScenario-176696806-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1191018195" status: 202 len: 0 microversion: 2.1 time: 0.113115 Aug 24 14:51:39.558032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 616/1190] 10.222.0.65 () {58 vars in 1272 bytes} [Wed Aug 24 14:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1191018195 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:51:39.830910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:39.831519 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:39.838453 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:39.838962 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:39.839383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:39.840070 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:39.840537 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:39.840942 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:39.854917 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 HTTP/1.1 Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:51:39.856623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:51:39.858385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'a4e58813-5807-452b-ae56-f0aeeb215ac9'} Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:51:39.859350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:51:39.861082 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:51:39.863437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:51:39.863437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7845d548-5754-4f2c-9ed3-150ffe1af8e6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 404 len: 111 microversion: 2.1 time: 0.031099 Aug 24 14:51:39.863437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 575/1191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:39 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:51:39.876862 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-21b77a64-d7b1-4faf-aeed-9a8ec2f00b5c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '.version_select at 0x7fbf7c2e34c0>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:40.009902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-21b77a64-d7b1-4faf-aeed-9a8ec2f00b5c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203959852" status: 202 len: 0 microversion: 2.1 time: 0.145565 Aug 24 14:51:40.010510 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 617/1192] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 24 14:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203959852 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:51:40.907253 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b091c4b9-e364-458f-bd15-8f277843cdd9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: .version_select at 0x7fbf782f8a60>, body: {"keypair": {"name": "tempest-keypair-507649406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXhzRkAx3Fu0WIAXk61K5lhZX+YJZ0y5BgdE1XcdK6QZYZKNHpM1POrFbPiEmZm7YqISy9TU+1CLs0/HQ7+GlDiSJMLQt3OoG2uEIm2213fTE77kZLiZPjYppS86OHmOQ=="}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:40.923915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-b091c4b9-e364-458f-bd15-8f277843cdd9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for project 13d426499b5b40818dca1573cb839b16. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:51:40.928553 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-b091c4b9-e364-458f-bd15-8f277843cdd9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for user f88f7857e1d24bb0b038b7f6e98a6f34 and project 13d426499b5b40818dca1573cb839b16. Resources: {'key_pairs'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:51:41.032341 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b091c4b9-e364-458f-bd15-8f277843cdd9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128843 Aug 24 14:51:41.032865 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 576/1193] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:51:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:44.436229 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1101252712", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72239629-4056-40ff-9127-a5a5ca07ba84"}], "security_groups": [{"name": "tempest-securitygroup--1187294385"}], "key_name": "tempest-keypair-507649406", "user_data": "}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:44.550934 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.network.neutron [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] validate_networks() for [('72239629-4056-40ff-9127-a5a5ca07ba84', None, None, None, None, None)] {{(pid=132890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:51:45.060101 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Flavor limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:51:45.065188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Image limits 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:51:45.065681 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Flavor pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:51:45.066928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Image pref 0:0:0 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:51:45.067466 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.virt.hardware [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:51:45.079853 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:45.081374 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:45.082034 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:45.083008 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:45.083942 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:45.084492 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:45.121096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for project 13d426499b5b40818dca1573cb839b16. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:51:45.126502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for user f88f7857e1d24bb0b038b7f6e98a6f34 and project 13d426499b5b40818dca1573cb839b16. Resources: {'cores', 'instances', 'ram'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:51:45.142293 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Going to run 1 instances... {{(pid=132890) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:51:45.144922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:51:45.285869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c3d75eaa-6de9-4598-9877-d34a2b8a98d7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.855231 Aug 24 14:51:45.299311 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c712b53f-0542-4d83-8858-bcdf28c06a57 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:45.300461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c712b53f-0542-4d83-8858-bcdf28c06a57 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:45.303472 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 618/1194] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:51:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:51:45.368832 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c712b53f-0542-4d83-8858-bcdf28c06a57 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:45.379975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c712b53f-0542-4d83-8858-bcdf28c06a57 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1241 microversion: 2.1 time: 0.083663 Aug 24 14:51:45.380568 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 577/1195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:45 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:46.401895 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:46.402566 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:46.404579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:46.409874 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:46.410376 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:46.410816 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:46.411836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:46.412295 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:46.412935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:46.439145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:46.493674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:46.513223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2e212c93-e913-4713-8729-2fef5af3d75e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1245 microversion: 2.1 time: 0.115570 Aug 24 14:51:46.514383 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 619/1196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:46 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1245 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:47.536861 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:47.538855 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:47.543105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:47.551837 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:47.552328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:47.552765 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:47.554346 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:47.554841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:47.555255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:47.688337 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:47.696750 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-359e96d7-ee61-4a48-8f82-e7d3b606f496 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1293 microversion: 2.1 time: 0.165567 Aug 24 14:51:47.697324 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 578/1197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:47 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:51:48.722164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:48.722715 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:48.730080 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:48.730578 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:48.731201 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:48.735461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:48.735461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:48.735461 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:49.135251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:49.144669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3ff7325b-98f7-45a0-9141-2c09f4d4df00 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1299 microversion: 2.1 time: 0.428060 Aug 24 14:51:49.145249 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 620/1198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:48 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1299 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:50.170405 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:50.175650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:50.181833 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:50.183167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:50.184013 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:50.185338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:50.185981 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:50.187326 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:50.423697 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:50.435454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-973e1c5d-7a13-4393-bdaa-e89e6ee4f989 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.270665 Aug 24 14:51:50.436126 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 579/1199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:50 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:50.860468 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-25c306b5-3411-4373-aa10-8775144a60c5 req-a8ba55fd-7163-4a83-9f83-fa27dc912f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770bde21-0ba3-46ac-aa57-1afeeb4a3bb8", "tag": "ff0095ef-5c9d-44e7-a458-195ec441de57"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:50.872743 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-25c306b5-3411-4373-aa10-8775144a60c5 req-a8ba55fd-7163-4a83-9f83-fa27dc912f4d service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:50.873228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-25c306b5-3411-4373-aa10-8775144a60c5 req-a8ba55fd-7163-4a83-9f83-fa27dc912f4d service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:50.873767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-25c306b5-3411-4373-aa10-8775144a60c5 req-a8ba55fd-7163-4a83-9f83-fa27dc912f4d service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:50.886598 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-25c306b5-3411-4373-aa10-8775144a60c5 req-a8ba55fd-7163-4a83-9f83-fa27dc912f4d service nova] Creating event network-changed:ff0095ef-5c9d-44e7-a458-195ec441de57 for instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 on hv-cinder-75671 Aug 24 14:51:50.892094 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-25c306b5-3411-4373-aa10-8775144a60c5 req-a8ba55fd-7163-4a83-9f83-fa27dc912f4d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036803 Aug 24 14:51:50.892702 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 621/1200] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:51.463344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:51.464171 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:51.483463 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:51.483992 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:51.484462 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:51.485492 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:51.486080 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:51.486543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:51.803947 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:51.813576 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-93093a3a-b87c-40f9-8706-4c1a8d8626aa tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.356666 Aug 24 14:51:51.830319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 580/1201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:51 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:52.844859 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:52.846091 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:52.857921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:52.858774 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:52.859486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:52.860660 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:52.861446 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:52.866059 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:53.036134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:53.045892 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-25e601f9-2a51-44f7-b3c0-99b9e312653b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.209296 Aug 24 14:51:53.053971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 622/1202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:52 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:54.069213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:54.069876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:54.077958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:54.078434 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:54.078867 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:54.079573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:54.080142 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:54.080572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:54.223070 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:54.231251 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-6d9afb5c-9209-4256-9eee-377b4c42682f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.166408 Aug 24 14:51:54.239923 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 581/1203] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:54 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:55.252494 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:55.253098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:55.255684 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:55.256409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=6 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:55.262151 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:55.262808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:55.263171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:55.263878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:55.264324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:55.264743 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:55.407202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:55.417630 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cd8d51d1-6215-48c2-81fd-a33a589733d4 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.168804 Aug 24 14:51:55.418522 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 623/1204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:55 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:56.439764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:56.444904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:56.444904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:56.448467 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:56.448953 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:56.449385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:56.450133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:56.450590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:56.451147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:56.593354 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:56.601575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3201b4cb-b43c-4288-9cd2-a92a611c4530 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.166216 Aug 24 14:51:56.602170 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 582/1205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:56 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:57.624568 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:57.625207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:57.632350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:57.632844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:57.633277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:57.634011 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:57.634457 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:57.635487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:57.767478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:57.775142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ca790983-fb97-40fb-bbac-543a73137608 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.154967 Aug 24 14:51:57.775711 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 624/1206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:57 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:51:58.368171 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-57863bc3-b89d-4942-979a-8540af5e5619 req-9a972be8-0c50-4dfe-9d7e-6b09b2119692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770bde21-0ba3-46ac-aa57-1afeeb4a3bb8", "name": "network-vif-plugged", "status": "completed", "tag": "ff0095ef-5c9d-44e7-a458-195ec441de57"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:51:58.378102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-57863bc3-b89d-4942-979a-8540af5e5619 req-9a972be8-0c50-4dfe-9d7e-6b09b2119692 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.378586 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-57863bc3-b89d-4942-979a-8540af5e5619 req-9a972be8-0c50-4dfe-9d7e-6b09b2119692 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.379043 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-57863bc3-b89d-4942-979a-8540af5e5619 req-9a972be8-0c50-4dfe-9d7e-6b09b2119692 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.391543 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-57863bc3-b89d-4942-979a-8540af5e5619 req-9a972be8-0c50-4dfe-9d7e-6b09b2119692 service nova] Creating event network-vif-plugged:ff0095ef-5c9d-44e7-a458-195ec441de57 for instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 on hv-cinder-75671 Aug 24 14:51:58.396991 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-57863bc3-b89d-4942-979a-8540af5e5619 req-9a972be8-0c50-4dfe-9d7e-6b09b2119692 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200355 Aug 24 14:51:58.397583 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 583/1207] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:51:58.796694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:51:58.797330 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:51:58.803791 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.804277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.804716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.805420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:51:58.805907 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:51:58.811555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:51:58.975500 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:51:58.983738 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-83eff887-ff25-4d59-9bd7-3cdc86b960f9 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.190902 Aug 24 14:51:58.984299 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 625/1208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:51:58 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:00.006570 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:00.007772 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:00.014782 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:00.015364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:00.015802 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:00.016501 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:00.016951 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:00.017375 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:00.040229 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=100 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:00.172792 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:00.180607 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cbf05112-1e79-40f6-8624-392558f357a7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1367 microversion: 2.1 time: 0.178897 Aug 24 14:52:00.181162 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 584/1209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:00 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:01.202321 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:01.202915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:01.209394 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:01.209914 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:01.210399 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:01.211100 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:01.211558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:01.211986 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:01.354053 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:52:01.361686 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1dbde154-d9d8-4f02-a37c-5bbb52064760 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1556 microversion: 2.1 time: 0.163403 Aug 24 14:52:01.362277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 626/1210] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:52:01 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:52:01.382719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:52:01.383270 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:52:01.390262 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:01.390747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:01.391313 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:01.392027 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:01.392481 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:01.392905 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:01.482863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-19a9b775-783f-4d55-aef9-3f3bcc147440 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104260 Aug 24 14:52:01.487897 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 585/1211] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 14:52:01 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:52:02.556353 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-8c84d513-3ccb-460f-b6ca-dd8fe51281fd req-da2f9be8-5264-425b-b020-26b9fa11ba55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770bde21-0ba3-46ac-aa57-1afeeb4a3bb8", "tag": "ff0095ef-5c9d-44e7-a458-195ec441de57"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:52:02.567209 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-8c84d513-3ccb-460f-b6ca-dd8fe51281fd req-da2f9be8-5264-425b-b020-26b9fa11ba55 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:52:02.567711 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-8c84d513-3ccb-460f-b6ca-dd8fe51281fd req-da2f9be8-5264-425b-b020-26b9fa11ba55 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:52:02.568133 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-8c84d513-3ccb-460f-b6ca-dd8fe51281fd req-da2f9be8-5264-425b-b020-26b9fa11ba55 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:52:02.580575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-8c84d513-3ccb-460f-b6ca-dd8fe51281fd req-da2f9be8-5264-425b-b020-26b9fa11ba55 service nova] Creating event network-changed:ff0095ef-5c9d-44e7-a458-195ec441de57 for instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 on hv-cinder-75671 Aug 24 14:52:02.585692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-8c84d513-3ccb-460f-b6ca-dd8fe51281fd req-da2f9be8-5264-425b-b020-26b9fa11ba55 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033148 Aug 24 14:52:02.586517 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 627/1212] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:32.704009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=15 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:32.704771 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:32.709171 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:32.709672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:32.715848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:32.718972 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:32.718972 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:32.718972 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:32.718972 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:32.719401 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:32.744111 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83c1a045-f512-4ba5-8962-799e44978168 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/ips" status: 200 len: 149 microversion: 2.1 time: 0.042277 Aug 24 14:53:32.745585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 586/1213] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:53:32 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:35.551159 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=17 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:35.553971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=42 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:35.556320 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f72532e7-f17c-4c10-8c27-f618a4a6a80c"}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:53:35.558951 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:35.565499 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:35.565978 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:35.566410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:35.567419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:35.567594 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:35.567935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:35.583202 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74c45570-531d-499a-8048-6bcb58f2ac17] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 14:53:36.591053 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] [74c45570-531d-499a-8048-6bcb58f2ac17] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 52728. Aug 24 14:53:37.227324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0df391e5-8a2b-4bce-96d9-ab12bb040970 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.678564 Aug 24 14:53:37.227982 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 628/1214] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:53:35 2022] POST /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 194 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:53:53.272287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f72532e7-f17c-4c10-8c27-f618a4a6a80c"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:53:53.285435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:53.285435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:53.285435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:53.285435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:53.285435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:53.286351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:53.286351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:53.286351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:53.443621 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Invalid volume: volume f72532e7-f17c-4c10-8c27-f618a4a6a80c is already attached to instances: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: POST /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments HTTP/1.1 Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 74 Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:53:53.446624 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {"volumeAttachment": {"volumeId": "f72532e7-f17c-4c10-8c27-f618a4a6a80c"}} Aug 24 14:53:53.448755 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Invalid volume: volume f72532e7-f17c-4c10-8c27-f618a4a6a80c is already attached to instances: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'server_id': '770bde21-0ba3-46ac-aa57-1afeeb4a3bb8', 'body': {'volumeAttachment': {'volumeId': 'f72532e7-f17c-4c10-8c27-f618a4a6a80c'}}} Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f72532e7-f17c-4c10-8c27-f618a4a6a80c is already attached to instances: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:53:53.449605 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f72532e7-f17c-4c10-8c27-f618a4a6a80c is already attached to instances: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:53:53.452774 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:53:53.458796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:53:53.458796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:53:53.458796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:53:53.458796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f72532e7-f17c-4c10-8c27-f618a4a6a80c is already attached to instances: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 Aug 24 14:53:53.458796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:53:53.458796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 400 to user: Invalid volume: volume f72532e7-f17c-4c10-8c27-f618a4a6a80c is already attached to instances: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:53:53.458796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-195ea57f-819a-48bd-9259-8c8fe9d6832b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.180850 Aug 24 14:53:53.458796 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 587/1215] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:53:53 2022] POST /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 174 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 14:53:53.532040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:53.533077 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:53.535913 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:53.536591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:53.542642 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:53.543223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:53.543665 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:53.544843 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:53.545502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:53.546013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:53.652207 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'services' on Instance uuid 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:53:53.882555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-bcbedde9-b867-49bb-897b-facf9b6c8c6a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments/f72532e7-f17c-4c10-8c27-f618a4a6a80c" status: 202 len: 0 microversion: 2.1 time: 0.354846 Aug 24 14:53:53.883537 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 629/1216] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:53:53 2022] DELETE /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments/f72532e7-f17c-4c10-8c27-f618a4a6a80c => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:53:53.892577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:53.894798 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:53.902616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:53.903096 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:53.903550 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:53.904236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:53.904683 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:53.905102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:53.945408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0aaf9c50-d9f8-437c-a097-04a3062d5919 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057231 Aug 24 14:53:53.946009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 588/1217] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:53:53 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:54.960442 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:54.962766 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:54.969160 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:54.970090 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:54.970573 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:54.971312 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:54.971775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:54.972195 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:55.006030 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-89b8f303-0481-4130-82cd-b6cab4013997 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050546 Aug 24 14:53:55.006619 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 630/1218] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:53:54 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:56.018901 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:56.021443 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:56.029364 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:56.029888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:56.030331 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:56.031038 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:56.031491 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:56.032005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:56.072499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-979f9ca3-bf19-4020-905e-fd90444f7ab3 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057582 Aug 24 14:53:56.073068 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 589/1219] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:53:56 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:57.088542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:57.090959 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:57.100889 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:57.101448 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:57.101890 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:57.102585 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:57.103081 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:57.103502 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:57.162599 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-656a112e-4807-42bb-830c-839f37e381d5 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059770 Aug 24 14:53:57.162599 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 631/1220] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:53:57 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:58.181674 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:58.183814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:58.191133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:58.191682 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:58.192117 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:58.192814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:58.193266 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:58.193686 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:58.240754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d775bb3a-67e9-4566-b471-15d1fe3ced83 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063176 Aug 24 14:53:58.241952 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 590/1221] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:53:58 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:53:59.255528 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:53:59.258134 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:53:59.265307 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:59.265848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:59.266309 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:59.267353 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:53:59.267817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:53:59.268243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:53:59.300109 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-f844093d-5ca9-4886-a688-026830b1aced tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050037 Aug 24 14:53:59.300690 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 632/1222] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:53:59 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:00.312339 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:00.315247 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:00.321818 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:00.322305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:00.322747 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:00.323455 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:00.323914 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:00.324330 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:00.355402 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-71da0340-8ddc-4600-9db9-127f6c100cf6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046947 Aug 24 14:54:00.355966 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 591/1223] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:54:00 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:54:00.422111 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:00.422707 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:00.429372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:00.429893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:00.430332 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:00.431032 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:00.431488 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:00.431909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:00.461416 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:54:00.777244 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-522a6e96-8eb5-455f-966a-4f33b9451bb2 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 204 len: 0 microversion: 2.1 time: 0.358663 Aug 24 14:54:00.777872 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 633/1224] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:54:00 2022] DELETE /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:54:00.788192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:00.788803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:00.795097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:00.795574 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:00.796005 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:00.796701 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:00.797146 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:00.798157 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:00.943280 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:00.952770 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d35880dd-a915-42c2-8b14-36021bbaba1a tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1681 microversion: 2.1 time: 0.170130 Aug 24 14:54:00.953355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 592/1225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:00 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:01.975442 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:01.976137 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:01.982507 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:01.982988 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:01.983420 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:01.984103 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:01.984553 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:01.985511 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:02.118746 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:02.127061 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1bcb42cf-61c0-47d4-bd19-d361642b94c8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1681 microversion: 2.1 time: 0.155902 Aug 24 14:54:02.127645 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 634/1226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:01 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:03.149309 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:03.149903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:03.157141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:03.157675 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:03.158171 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:03.158937 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:03.159403 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:03.159834 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:03.432237 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:03.433957 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-87580df4-ebbe-46b4-8f63-10391ca40cf8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1681 microversion: 2.1 time: 0.288107 Aug 24 14:54:03.434128 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 593/1227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:03 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:03.975119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-36d969c7-d5b1-4694-8b9f-bd2d1947e7f4 req-dd2df1ba-ba8f-44df-9264-99ee664bdb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770bde21-0ba3-46ac-aa57-1afeeb4a3bb8", "name": "network-vif-deleted", "tag": "ff0095ef-5c9d-44e7-a458-195ec441de57"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:03.987317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-36d969c7-d5b1-4694-8b9f-bd2d1947e7f4 req-dd2df1ba-ba8f-44df-9264-99ee664bdb93 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:03.988223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-36d969c7-d5b1-4694-8b9f-bd2d1947e7f4 req-dd2df1ba-ba8f-44df-9264-99ee664bdb93 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:03.988666 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-36d969c7-d5b1-4694-8b9f-bd2d1947e7f4 req-dd2df1ba-ba8f-44df-9264-99ee664bdb93 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:04.005729 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-36d969c7-d5b1-4694-8b9f-bd2d1947e7f4 req-dd2df1ba-ba8f-44df-9264-99ee664bdb93 service nova] Creating event network-vif-deleted:ff0095ef-5c9d-44e7-a458-195ec441de57 for instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 on hv-cinder-75671 Aug 24 14:54:04.012095 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-36d969c7-d5b1-4694-8b9f-bd2d1947e7f4 req-dd2df1ba-ba8f-44df-9264-99ee664bdb93 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040593 Aug 24 14:54:04.016671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 635/1228] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:04.458878 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:04.459719 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:04.467030 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:04.467514 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:04.467941 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:04.468639 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:04.470093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:04.470713 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:04.507776 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:04.508351 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:04.508877 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:04.509401 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.objects.instance [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'fault' on Instance uuid 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 {{(pid=132892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:54:04.554966 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:04.563764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-86262b4d-f5ba-46ef-aad6-9a2aab542574 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 200 len: 1331 microversion: 2.1 time: 0.110502 Aug 24 14:54:04.564585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 594/1229] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:04 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:54:05.585765 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:05.586384 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:05.592699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:05.593171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:05.593597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:05.595323 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:05.595927 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:05.596351 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:05.609373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 HTTP/1.1 Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:54:05.611980 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:54:05.613817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '770bde21-0ba3-46ac-aa57-1afeeb4a3bb8'} Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:54:05.615010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:54:05.616750 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:54:05.618449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:54:05.618449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3d9238a1-5f52-434a-9dbb-f00fe9a2594c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 404 len: 111 microversion: 2.1 time: 0.032535 Aug 24 14:54:05.618449 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 636/1230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:05 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:54:05.622271 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b9110306-a3d5-4f84-82d4-34f688a2f9cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '.version_select at 0x7fbf78394430>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:05.626998 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9110306-a3d5-4f84-82d4-34f688a2f9cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [7956656c-acab-4fbe-b869-92ee7e2a14b2] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 14:54:06.634815 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9110306-a3d5-4f84-82d4-34f688a2f9cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [7956656c-acab-4fbe-b869-92ee7e2a14b2] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 52900. Aug 24 14:54:06.754526 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b9110306-a3d5-4f84-82d4-34f688a2f9cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507649406" status: 202 len: 0 microversion: 2.1 time: 1.135838 Aug 24 14:54:06.755138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 595/1231] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 14:54:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507649406 => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:54:07.648020 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2820a615-c5cd-416b-95b8-22a57d1f9355 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: .version_select at 0x7fbf7836d4c0>, body: {"keypair": {"name": "tempest-keypair-1260649018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZxidvVf0IZv6WBPxhsnnVtdmbikRF9YjzwQdJhXU37yJ1k4qs+V5p58ZMCsMZHukGE7Q3z85ZPJvXwAOnXRJZL6CvKpg2iwplh/jzpSjpvqQp2B9I0S5FF1rSX3wAtCg=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:07.663365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-2820a615-c5cd-416b-95b8-22a57d1f9355 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for project 13d426499b5b40818dca1573cb839b16. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:54:07.667386 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-2820a615-c5cd-416b-95b8-22a57d1f9355 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for user f88f7857e1d24bb0b038b7f6e98a6f34 and project 13d426499b5b40818dca1573cb839b16. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:54:07.819401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2820a615-c5cd-416b-95b8-22a57d1f9355 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175422 Aug 24 14:54:07.820102 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 637/1232] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:54:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:10.171053 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1603912986", "imageRef": "30a24582-4635-43ee-a2f8-37e663d8c239", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72239629-4056-40ff-9127-a5a5ca07ba84"}], "security_groups": [{"name": "tempest-securitygroup--174057917"}], "key_name": "tempest-keypair-1260649018", "user_data": "}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:10.286974 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] validate_networks() for [('72239629-4056-40ff-9127-a5a5ca07ba84', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:54:10.765924 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:54:10.766347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:54:10.770536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:54:10.770536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:54:10.770536 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:54:10.777853 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:10.778336 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:10.778773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:10.779505 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:10.779961 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:10.780387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:10.799258 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for project 13d426499b5b40818dca1573cb839b16. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:54:10.815431 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Getting quotas for user f88f7857e1d24bb0b038b7f6e98a6f34 and project 13d426499b5b40818dca1573cb839b16. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:54:10.815699 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:54:10.818055 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='30a24582-4635-43ee-a2f8-37e663d8c239',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:54:10.937312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-faa4ba59-4cfb-4724-8f6a-3e90686dceda tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.771243 Aug 24 14:54:10.937988 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 596/1233] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:54:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:54:10.949889 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1a047785-400f-4c1f-b063-ae14d92e6118 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:10.950500 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1a047785-400f-4c1f-b063-ae14d92e6118 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:11.007245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-1a047785-400f-4c1f-b063-ae14d92e6118 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:11.014380 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1a047785-400f-4c1f-b063-ae14d92e6118 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1242 microversion: 2.1 time: 0.068736 Aug 24 14:54:11.014880 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 638/1234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:10 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:12.035984 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:12.036594 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:12.042882 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:12.043367 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:12.043803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:12.044508 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:12.044952 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:12.045374 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:12.119089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:12.127863 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-edd9c53e-47a6-4562-aa9c-2fba34a13ae6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1246 microversion: 2.1 time: 0.096195 Aug 24 14:54:12.128465 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 597/1235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:12 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:13.148703 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:13.149369 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:13.155758 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:13.156235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:13.156671 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:13.157364 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:13.158354 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:13.158791 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:13.224199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:13.231977 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ee9411ce-69ae-4c5a-95e9-abc2ea824323 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1294 microversion: 2.1 time: 0.087163 Aug 24 14:54:13.232595 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 639/1236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:13 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:14.253285 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:14.253939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:14.260446 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:14.260935 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:14.261371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:14.262106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:14.262745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:14.263182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:14.340584 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:14.349092 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-2bf97209-ef10-4ec5-9079-f18e569520ca tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1300 microversion: 2.1 time: 0.099982 Aug 24 14:54:14.349670 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 598/1237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:14 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:15.374961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:15.376063 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:15.387145 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:15.387622 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:15.388066 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:15.388779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:15.389237 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:15.389732 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:15.615167 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:15.621779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e9301278-b177-4a3d-bd55-e44b7720634f tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1367 microversion: 2.1 time: 0.254151 Aug 24 14:54:15.622372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 640/1238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:15 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:15.784340 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-9c509d4f-2a10-4333-8a1e-8ba7a17c9c13 req-66dfa217-ad0c-4b62-8672-da905b73435d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c438ed-8f61-471f-b0ee-9eaf46aa9213", "tag": "3b1916ac-1001-4149-968b-4c0959a7f8bc"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:15.800206 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9c509d4f-2a10-4333-8a1e-8ba7a17c9c13 req-66dfa217-ad0c-4b62-8672-da905b73435d service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:15.801051 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9c509d4f-2a10-4333-8a1e-8ba7a17c9c13 req-66dfa217-ad0c-4b62-8672-da905b73435d service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:15.801888 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-9c509d4f-2a10-4333-8a1e-8ba7a17c9c13 req-66dfa217-ad0c-4b62-8672-da905b73435d service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:15.825135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-9c509d4f-2a10-4333-8a1e-8ba7a17c9c13 req-66dfa217-ad0c-4b62-8672-da905b73435d service nova] Creating event network-changed:3b1916ac-1001-4149-968b-4c0959a7f8bc for instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 on hv-cinder-75671 Aug 24 14:54:15.834735 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-9c509d4f-2a10-4333-8a1e-8ba7a17c9c13 req-66dfa217-ad0c-4b62-8672-da905b73435d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058341 Aug 24 14:54:15.836612 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 599/1239] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:16.645260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:16.645842 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:16.652477 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:16.652962 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:16.653393 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:16.654150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:16.654603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:16.655023 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:16.792092 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:16.800681 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0df7a387-5837-4e2a-b30d-29ee13c13f64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1367 microversion: 2.1 time: 0.159713 Aug 24 14:54:16.801251 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 641/1240] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:16 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:17.822251 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:17.822945 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:17.829347 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:17.829998 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:17.830442 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:17.831161 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:17.831610 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:17.832033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:17.964609 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:17.972791 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9519caf8-6660-4f56-b52e-9d9bbd25cd64 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1367 microversion: 2.1 time: 0.155245 Aug 24 14:54:17.973425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 600/1241] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:17 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:18.994483 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:18.995133 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:19.002111 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:19.002709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:19.003150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:19.003839 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:19.004298 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:19.004723 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:19.141120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:19.148252 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-61d36636-323b-4d29-9baa-eafafd16a15b tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1367 microversion: 2.1 time: 0.157691 Aug 24 14:54:19.148817 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 642/1242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:18 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:20.168542 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:20.169148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:20.176089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:20.176573 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:20.177009 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:20.177699 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:20.178186 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:20.178610 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:20.313384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:20.321677 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d2864655-d796-472b-a2c4-5d6b3e83fbd6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1367 microversion: 2.1 time: 0.156953 Aug 24 14:54:20.322270 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 601/1243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:20 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:20.800976 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-a80c09d6-7f65-49ce-9b5d-a53b9e7c230d req-83d5c09e-faed-40d7-b07a-da62fb45d4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c438ed-8f61-471f-b0ee-9eaf46aa9213", "name": "network-vif-plugged", "status": "completed", "tag": "3b1916ac-1001-4149-968b-4c0959a7f8bc"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:20.811206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a80c09d6-7f65-49ce-9b5d-a53b9e7c230d req-83d5c09e-faed-40d7-b07a-da62fb45d4bc service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:20.811683 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a80c09d6-7f65-49ce-9b5d-a53b9e7c230d req-83d5c09e-faed-40d7-b07a-da62fb45d4bc service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:20.812119 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-a80c09d6-7f65-49ce-9b5d-a53b9e7c230d req-83d5c09e-faed-40d7-b07a-da62fb45d4bc service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:20.822786 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-a80c09d6-7f65-49ce-9b5d-a53b9e7c230d req-83d5c09e-faed-40d7-b07a-da62fb45d4bc service nova] Creating event network-vif-plugged:3b1916ac-1001-4149-968b-4c0959a7f8bc for instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 on hv-cinder-75671 Aug 24 14:54:20.827697 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-a80c09d6-7f65-49ce-9b5d-a53b9e7c230d req-83d5c09e-faed-40d7-b07a-da62fb45d4bc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030463 Aug 24 14:54:20.828320 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 643/1244] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:21.342699 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:21.343484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:21.345442 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:21.346208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=6 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:21.358910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:21.358910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:21.358910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:21.358910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:21.359577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:21.359577 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:21.495854 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:21.511425 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-04dac488-96c9-4c38-8ca0-f82591eb4afe tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1367 microversion: 2.1 time: 0.172655 Aug 24 14:54:21.511999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 602/1245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:21 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:22.539313 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=6 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:22.544028 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:22.544740 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:22.553269 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:22.554958 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:22.555419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:22.556147 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:22.556606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:22.557040 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:22.703968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:22.712843 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-143050d1-dd29-467e-8c18-1307594f039e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1367 microversion: 2.1 time: 0.174470 Aug 24 14:54:22.713403 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 644/1246] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:22 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:23.733867 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:23.734510 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:23.737066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:23.741797 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:23.742283 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:23.742718 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:23.743408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:23.743909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:23.744334 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:23.746936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=89 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:23.882305 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:54:23.890338 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ace6b3ee-1480-4794-a8ea-b772ba7fd3e1 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1556 microversion: 2.1 time: 0.160370 Aug 24 14:54:23.890909 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 603/1247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:54:23 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:54:23.910812 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:54:23.911577 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:54:23.913604 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:23.918429 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:23.918902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:23.919333 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:23.920020 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:23.920465 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:23.920885 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:23.923858 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:24.000782 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c9d0e8d5-3389-4439-87c5-1848bbfa6b41 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093932 Aug 24 14:54:24.001990 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 645/1248] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 14:54:23 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:54:25.033125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-b19d180c-1192-49ac-8c3e-bcab12d0939b req-18b0f5c8-758c-4a6e-86e8-16e8fd6d809c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c438ed-8f61-471f-b0ee-9eaf46aa9213", "tag": "3b1916ac-1001-4149-968b-4c0959a7f8bc"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:54:25.043253 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b19d180c-1192-49ac-8c3e-bcab12d0939b req-18b0f5c8-758c-4a6e-86e8-16e8fd6d809c service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:54:25.043726 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b19d180c-1192-49ac-8c3e-bcab12d0939b req-18b0f5c8-758c-4a6e-86e8-16e8fd6d809c service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:54:25.044149 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b19d180c-1192-49ac-8c3e-bcab12d0939b req-18b0f5c8-758c-4a6e-86e8-16e8fd6d809c service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:54:25.056366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-b19d180c-1192-49ac-8c3e-bcab12d0939b req-18b0f5c8-758c-4a6e-86e8-16e8fd6d809c service nova] Creating event network-changed:3b1916ac-1001-4149-968b-4c0959a7f8bc for instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 on hv-cinder-75671 Aug 24 14:54:25.061445 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-b19d180c-1192-49ac-8c3e-bcab12d0939b req-18b0f5c8-758c-4a6e-86e8-16e8fd6d809c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032708 Aug 24 14:54:25.062119 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 604/1249] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 14:54:56.456337 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:54:56.456987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 14:54:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:55:37.740700 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:37.741513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:37.748891 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:37.749400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:37.749923 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:37.750680 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:37.751100 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:37.751527 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:37.775598 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-38eceb8e-c005-47e8-8bd5-9275180cf128 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/ips" status: 200 len: 149 microversion: 2.1 time: 0.041927 Aug 24 14:55:37.776165 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 646/1250] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 14:55:37 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:55:39.386445 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:39.387210 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=7 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:39.392663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59bd5c4a-4fc4-4f66-8639-763ce14cdaf7"}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:55:39.395114 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:39.401521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:39.402040 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:39.402500 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:39.403245 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:39.404105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:39.404285 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:40.273880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a012c944-81c9-4aef-8457-34930bc3ffc0 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "POST /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889494 Aug 24 14:55:40.274485 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 605/1251] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 14:55:39 2022] POST /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:55:48.953123 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:48.953728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:48.960958 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:48.961432 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:48.961915 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:48.962581 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:48.963028 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:48.963445 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:49.046146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lazy-loading 'services' on Instance uuid e8c438ed-8f61-471f-b0ee-9eaf46aa9213 {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:55:49.306028 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-b57de613-598e-460b-979b-3151b16b45cc tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments/59bd5c4a-4fc4-4f66-8639-763ce14cdaf7" status: 202 len: 0 microversion: 2.1 time: 0.357357 Aug 24 14:55:49.306603 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 647/1252] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 14:55:48 2022] DELETE /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments/59bd5c4a-4fc4-4f66-8639-763ce14cdaf7 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:55:49.317571 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:49.319937 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:49.326628 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:49.327106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:49.327569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:49.328222 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:49.328663 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:49.329080 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:49.360142 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-bd1f4466-a855-46e4-aef3-8c41f70be551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047736 Aug 24 14:55:49.360685 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 606/1253] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:55:49 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:55:50.374310 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:50.376928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:50.384035 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:50.384526 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:50.384969 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:50.385733 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:50.386218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:50.386641 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:50.418318 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-c57f1f9b-a605-4267-9794-49fac37a99c6 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049316 Aug 24 14:55:50.418879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 648/1254] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:55:50 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:55:51.431103 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:51.433319 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:51.440670 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:51.441143 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:51.441569 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:51.442286 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:51.442731 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:51.443147 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:51.472831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9d6d14c0-86e1-4ec8-a2e6-698b6e893551 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045714 Aug 24 14:55:51.473383 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 607/1255] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 14:55:51 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 14:55:51.536970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:51.537573 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:51.544579 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:51.545041 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:51.545472 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:51.546205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:51.546657 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:51.547083 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:51.572560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 14:55:51.929419 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-257195a0-e7b2-4bca-b151-452c9c81a695 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 204 len: 0 microversion: 2.1 time: 0.396328 Aug 24 14:55:51.930393 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 649/1256] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:55:51 2022] DELETE /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 14:55:51.938521 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:51.941236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:51.945304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:51.945799 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:51.946227 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:51.946903 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:51.947346 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:51.947762 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:52.086229 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:55:52.095144 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ef33aa63-2d5e-4413-a348-8aa80a3c7d61 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1681 microversion: 2.1 time: 0.160476 Aug 24 14:55:52.095703 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 608/1257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:55:51 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:55:53.118121 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:53.118898 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:53.125565 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:53.126079 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:53.126508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:53.127211 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:53.127639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:53.128058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:53.260922 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:55:53.269694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-895eb51f-d838-4deb-a709-c54eccac4ddb tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1681 microversion: 2.1 time: 0.155780 Aug 24 14:55:53.270292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 650/1258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:55:53 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:55:54.292067 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:54.292783 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:54.299656 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:54.300231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:54.300748 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:54.301525 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:54.302088 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:54.302811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:54.527287 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:55:54.536073 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-342c81d6-9051-4dfd-bb3c-63c800bb9d9c tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1681 microversion: 2.1 time: 0.247933 Aug 24 14:55:54.536631 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 609/1259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:55:54 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:55:55.393350 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-c2630cb5-4ba9-49b6-90ce-12fec8cbccfa req-db7894f2-eff0-44c5-b82f-282f763582bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c438ed-8f61-471f-b0ee-9eaf46aa9213", "name": "network-vif-deleted", "tag": "3b1916ac-1001-4149-968b-4c0959a7f8bc"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:55:55.409000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c2630cb5-4ba9-49b6-90ce-12fec8cbccfa req-db7894f2-eff0-44c5-b82f-282f763582bb service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:55.409559 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c2630cb5-4ba9-49b6-90ce-12fec8cbccfa req-db7894f2-eff0-44c5-b82f-282f763582bb service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:55.410000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-c2630cb5-4ba9-49b6-90ce-12fec8cbccfa req-db7894f2-eff0-44c5-b82f-282f763582bb service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:55.426071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-c2630cb5-4ba9-49b6-90ce-12fec8cbccfa req-db7894f2-eff0-44c5-b82f-282f763582bb service nova] Creating event network-vif-deleted:3b1916ac-1001-4149-968b-4c0959a7f8bc for instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 on hv-cinder-75671 Aug 24 14:55:55.431619 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-c2630cb5-4ba9-49b6-90ce-12fec8cbccfa req-db7894f2-eff0-44c5-b82f-282f763582bb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189328 Aug 24 14:55:55.432485 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 651/1260] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:55:55.557676 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:55.558359 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:55.565935 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:55.566428 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:55.570196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:55.570196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:55.570196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:55.570196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:55.648019 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88f7857e1d24bb0b038b7f6e98a6f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d426499b5b40818dca1573cb839b16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:55:55.658712 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-ab64e946-955c-42d7-8386-57accbc25656 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 200 len: 1327 microversion: 2.1 time: 0.104998 Aug 24 14:55:55.668109 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 610/1261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:55:55 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:55:56.681611 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:56.683191 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:56.688722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:56.689177 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:56.689616 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:56.690344 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:56.690806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:56.691234 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:56.704985 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 HTTP/1.1 Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:55:56.706734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:56.708629 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'e8c438ed-8f61-471f-b0ee-9eaf46aa9213'} Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:55:56.709635 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:56.711453 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:56.712914 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:55:56.712914 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-35c42e35-9141-4229-9418-bd44c5743f7e tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 404 len: 111 microversion: 2.1 time: 0.031613 Aug 24 14:55:56.712914 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 652/1262] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:55:56 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:55:56.718307 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d85ee8df-e9fb-4aa9-84df-dfd1ca69dfee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '.version_select at 0x7fbf783ba310>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:56.819457 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d85ee8df-e9fb-4aa9-84df-dfd1ca69dfee tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260649018" status: 202 len: 0 microversion: 2.1 time: 0.105625 Aug 24 14:55:56.820041 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 611/1263] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 24 14:55:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260649018 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:55:58.934820 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:58.935365 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:58.941783 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:58.942276 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:58.942744 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:58.943441 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:58.943897 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:58.944324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:58.958247 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 HTTP/1.1 Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:55:58.959792 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:58.961534 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'e8c438ed-8f61-471f-b0ee-9eaf46aa9213'} Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:55:58.962560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:58.964236 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:55:58.965815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:55:58.965815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-ef1018c7-f198-46c2-8902-70afb4500d70 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 404 len: 111 microversion: 2.1 time: 0.030241 Aug 24 14:55:58.965815 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 653/1264] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:55:58 2022] DELETE /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:55:58.971450 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:55:58.972066 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: e8c438ed-8f61-471f-b0ee-9eaf46aa9213] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:55:58.979003 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:58.979172 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:58.979554 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:58.980239 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:55:58.980685 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:55:58.981108 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:55:58.994556 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 HTTP/1.1 Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:55:58.996167 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:58.997949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'e8c438ed-8f61-471f-b0ee-9eaf46aa9213'} Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:55:58.999004 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. Aug 24 14:55:59.000745 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:55:59.002517 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance e8c438ed-8f61-471f-b0ee-9eaf46aa9213 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:55:59.002517 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-0c754be3-3edf-44fe-8fdb-255980424316 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213" status: 404 len: 111 microversion: 2.1 time: 0.031524 Aug 24 14:55:59.002517 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 612/1265] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:55:58 2022] GET /compute/v2.1/servers/e8c438ed-8f61-471f-b0ee-9eaf46aa9213 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:00.268373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:00.268905 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:00.275196 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:00.275672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:00.276103 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:00.276779 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:00.277228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:00.277644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:00.290848 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 HTTP/1.1 Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:56:00.292373 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.294173 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '770bde21-0ba3-46ac-aa57-1afeeb4a3bb8'} Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:00.295606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.297410 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.299210 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:00.299210 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e88d7aa6-03f2-4eed-92d1-f5867e99bdf7 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 404 len: 111 microversion: 2.1 time: 0.029793 Aug 24 14:56:00.299210 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 654/1266] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:56:00 2022] DELETE /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:00.302231 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:00.302841 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:00.308943 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:00.309414 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:00.309871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:00.311168 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:00.311810 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:00.312224 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:00.327848 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 HTTP/1.1 Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:56:00.329352 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.331083 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': '770bde21-0ba3-46ac-aa57-1afeeb4a3bb8'} Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:00.331958 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. Aug 24 14:56:00.333343 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.335208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance 770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:00.335208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-00cb9a6b-abb7-499e-9cff-e8672fb881b8 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8" status: 404 len: 111 microversion: 2.1 time: 0.032188 Aug 24 14:56:00.335208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 613/1267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:00 2022] GET /compute/v2.1/servers/770bde21-0ba3-46ac-aa57-1afeeb4a3bb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:00.339816 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:00.340319 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:00.346631 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:00.347112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:00.347657 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:00.348355 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:00.348813 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:00.349245 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:00.363199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a HTTP/1.1 Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:56:00.364798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.366716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'b6050d18-78e2-43dd-8006-bfbb0480d25a'} Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:00.367550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.368971 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.370358 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:00.370358 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1e82995a-76f0-4a08-8fbd-6c14450854ba tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 404 len: 111 microversion: 2.1 time: 0.030375 Aug 24 14:56:00.370358 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 655/1268] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:56:00 2022] DELETE /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:00.375641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:00.376254 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: b6050d18-78e2-43dd-8006-bfbb0480d25a] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:00.382242 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:00.382714 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:00.383142 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:00.383904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:00.384350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:00.384769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:00.398655 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a HTTP/1.1 Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:56:00.400181 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.401925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'b6050d18-78e2-43dd-8006-bfbb0480d25a'} Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:00.402989 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. Aug 24 14:56:00.404618 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:00.406127 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance b6050d18-78e2-43dd-8006-bfbb0480d25a could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:00.406127 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-9dc69f51-a297-4c85-bf23-e34f304f1c16 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a" status: 404 len: 111 microversion: 2.1 time: 0.030392 Aug 24 14:56:00.406127 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 614/1269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:00 2022] GET /compute/v2.1/servers/b6050d18-78e2-43dd-8006-bfbb0480d25a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:01.739845 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:01.740342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:01.746775 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:01.747255 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:01.747691 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:01.748564 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:01.749009 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:01.749467 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:01.765103 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: DELETE /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 HTTP/1.1 Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 14:56:01.766669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.768431 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': 'a4e58813-5807-452b-ae56-f0aeeb215ac9'} Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:01.769390 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.771010 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.772591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:01.772591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3cd56f4d-d260-4a44-adfb-75a6ad2cdc51 tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 404 len: 111 microversion: 2.1 time: 0.032020 Aug 24 14:56:01.772591 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 656/1270] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 14:56:01 2022] DELETE /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:01.776702 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:56:01.777443 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] [instance: a4e58813-5807-452b-ae56-f0aeeb215ac9] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:56:01.784936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:01.785419 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:01.785880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:01.786585 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:56:01.787036 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:56:01.787460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:56:01.801950 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.wsgi [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] HTTP exception thrown: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Request method failure captured: Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: request: GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 HTTP/1.1 Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept: application/json Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Accept-Encoding: identity Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Connection: close Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Length: 0 Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Content-Type: application/json Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Host: 10.222.0.65 Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Openstack-System-Scope: None Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: User-Agent: python-urllib3/1.26.11 Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Auth-Token: gAAAAABjBjnJwiLSg_XoIDAF2r8_6WishMerqKGIx27T_-jAf5x6gCAqvJLJ-olsLIqqeeAudnMBDb_HNrc0bz7ri9MCBnjHSZ0oO8FUAekIB9vgFWgUbnFBbnuhRVNT8YhCl6gjLDV5SJ3N3jvsu9GFDZHyNHfnc3Wh6v-DPjx6OvmUsrks0kE Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Id: None Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Domain-Name: None Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Identity-Status: Confirmed Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Is-Admin-Project: True Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Id: default Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Domain-Name: Default Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Project-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Role: member,reader Aug 24 14:56:01.803484 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Roles: member,reader Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/13d426499b5b40818dca1573cb839b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_13d426499b5b40818dca1573cb839b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/13d426499b5b40818dca1573cb839b16"}]}] Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Id: 13d426499b5b40818dca1573cb839b16 Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-24037729 Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Id: default Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Domain-Name: Default Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Id: f88f7857e1d24bb0b038b7f6e98a6f34 Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: X-User-Name: tempest-AttachVolumeNegativeTest-24037729-project Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: method: > Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: exception: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.805822 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: action_args: {'id': 'a4e58813-5807-452b-ae56-f0aeeb215ac9'} Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 14:56:01.810062 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. Aug 24 14:56:01.813355 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR nova.api.openstack.wsgi Aug 24 14:56:01.816086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] Returning 404 to user: Instance a4e58813-5807-452b-ae56-f0aeeb215ac9 could not be found. {{(pid=132892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 14:56:01.816086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-8743b201-17d5-435a-a2fc-9e9a87f60b8d tempest-AttachVolumeNegativeTest-24037729 tempest-AttachVolumeNegativeTest-24037729-project] 10.222.0.65 "GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9" status: 404 len: 111 microversion: 2.1 time: 0.032077 Aug 24 14:56:01.816086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 615/1271] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:56:01 2022] GET /compute/v2.1/servers/a4e58813-5807-452b-ae56-f0aeeb215ac9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 14:56:24.801975 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:56:24.802575 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 14:56:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:56:27.462459 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:56:27.463025 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Wed Aug 24 14:56:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:56:51.696272 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:51.697012 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:51.910879 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-27cc8305-3044-40c1-bfda-d7337e147f20 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Action: 'create', calling method: .version_select at 0x7fbf7c182dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1486306073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrmi8BGICyVFaMA26HR+Vh0NVSIydljJQ7RVyRtyQlsmaNAPRLTLdHKIZSxELBwr4cio6D7XgyyOJ6zXbQUiQr1IY0aoaa2CFXxBEN0kPo0FsEkZgtWUatTJu83kTvnzA=="}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:56:51.926422 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-27cc8305-3044-40c1-bfda-d7337e147f20 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Getting quotas for project c62ff2597c94498ca5f9873d87edba22. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:56:51.930716 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.quota [None req-27cc8305-3044-40c1-bfda-d7337e147f20 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Getting quotas for user 9b3b1bc724974112972af06eb577ffe1 and project c62ff2597c94498ca5f9873d87edba22. Resources: {'key_pairs'} {{(pid=132890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:56:52.070171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-27cc8305-3044-40c1-bfda-d7337e147f20 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.380218 Aug 24 14:56:52.071039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 657/1272] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 14:56:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:57:17.088131 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:17.088881 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:17.093257 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-842957803", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1486306073", "security_groups": [{"name": "tempest-secgroup-smoke-1258007581"}], "networks": [{"uuid": "86e9e69c-22b5-469a-b869-f06aac0c1fe9"}], "block_device_mapping_v2": [{"uuid": "b4efe253-62cb-47e6-bee3-f6570fb5a9fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:57:17.208314 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.network.neutron [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] validate_networks() for [('86e9e69c-22b5-469a-b869-f06aac0c1fe9', None, None, None, None, None)] {{(pid=132892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 14:57:17.836687 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Flavor limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 14:57:17.837149 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Image limits 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 14:57:17.837630 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Flavor pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 14:57:17.838140 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Image pref 0:0:0 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 14:57:17.838576 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.virt.hardware [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 14:57:17.847773 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:17.848253 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:17.848690 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:17.849409 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:17.849891 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:17.850322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:17.867328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Getting quotas for project c62ff2597c94498ca5f9873d87edba22. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 14:57:17.872052 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.quota [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Getting quotas for user 9b3b1bc724974112972af06eb577ffe1 and project c62ff2597c94498ca5f9873d87edba22. Resources: {'cores', 'instances', 'ram'} {{(pid=132892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 14:57:17.928563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Going to run 1 instances... {{(pid=132892) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 14:57:17.930794 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4efe253-62cb-47e6-bee3-f6570fb5a9fd',volume_size=None,volume_type=None)] {{(pid=132892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 14:57:18.489306 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-65edeec0-a42d-4ed5-b049-8cdbcf028a1a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.402578 Aug 24 14:57:18.490694 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 616/1273] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 14:57:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 14:57:18.499213 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=4 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:18.508013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:18.508013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e5a5f648-6c91-4953-af79-b1ac3224626a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:18.508013 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e5a5f648-6c91-4953-af79-b1ac3224626a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:18.571426 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e5a5f648-6c91-4953-af79-b1ac3224626a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:18.578674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e5a5f648-6c91-4953-af79-b1ac3224626a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1088 microversion: 2.1 time: 0.080896 Aug 24 14:57:18.579258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 658/1274] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:18 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:57:19.600288 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-09455159-4b81-4ea8-bdb1-cdc07154dad5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:19.600910 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-09455159-4b81-4ea8-bdb1-cdc07154dad5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:19.655030 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-09455159-4b81-4ea8-bdb1-cdc07154dad5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:19.662105 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-09455159-4b81-4ea8-bdb1-cdc07154dad5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1088 microversion: 2.1 time: 0.066218 Aug 24 14:57:19.662722 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 617/1275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:19 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:20.684270 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:20.684878 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:20.692348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:20.692821 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:20.693250 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:20.693966 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:20.694418 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:20.694836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:20.756893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:20.765411 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dd3bbbfe-e95f-4b9a-9388-65b0cb08cd24 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1186 microversion: 2.1 time: 0.085917 Aug 24 14:57:20.765997 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 659/1276] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:20 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:21.787190 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:21.787807 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:21.795205 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:21.796640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:21.796640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:21.796929 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:21.797313 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:21.797737 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:22.064050 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:22.072216 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4e79b555-b2fa-4129-8a78-0285880caef7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1272 microversion: 2.1 time: 0.288800 Aug 24 14:57:22.072803 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 618/1277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:21 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:22.985074 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-6ba418fc-4705-4900-bec9-5c86111d5af6 req-31e3954d-8e7e-47f6-9561-0167d873ff8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fea163-b862-4e92-99c1-0cbac9b9f353", "tag": "c9e8299e-8cc5-49f2-b548-617eecfa78b3"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:57:22.997908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-6ba418fc-4705-4900-bec9-5c86111d5af6 req-31e3954d-8e7e-47f6-9561-0167d873ff8e service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:22.998433 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-6ba418fc-4705-4900-bec9-5c86111d5af6 req-31e3954d-8e7e-47f6-9561-0167d873ff8e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:22.998869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-6ba418fc-4705-4900-bec9-5c86111d5af6 req-31e3954d-8e7e-47f6-9561-0167d873ff8e service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:23.010440 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-6ba418fc-4705-4900-bec9-5c86111d5af6 req-31e3954d-8e7e-47f6-9561-0167d873ff8e service nova] Creating event network-changed:c9e8299e-8cc5-49f2-b548-617eecfa78b3 for instance 60fea163-b862-4e92-99c1-0cbac9b9f353 on hv-cinder-75671 Aug 24 14:57:23.016562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-6ba418fc-4705-4900-bec9-5c86111d5af6 req-31e3954d-8e7e-47f6-9561-0167d873ff8e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 Aug 24 14:57:23.017238 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 660/1278] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:57:23.095329 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:23.095939 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:23.103387 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:23.103871 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:23.104344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:23.105158 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:23.105659 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:23.106148 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:23.337101 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:23.345400 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fa9aff76-7221-4a03-a9b9-f34e0903f0dc tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.253997 Aug 24 14:57:23.346146 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 619/1279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:23 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:24.368284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:24.369015 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:24.375542 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:24.376022 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:24.376460 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:24.377158 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:24.377644 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:24.378095 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:24.517228 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:24.525153 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-70226889-07c9-450d-bae1-517012a26f29 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.161795 Aug 24 14:57:24.525722 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 661/1280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:24 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:25.547793 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:25.548441 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:25.554936 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:25.555412 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:25.555838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:25.556527 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:25.556973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:25.557393 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:25.689008 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:25.697033 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-7a11f8ef-d653-468c-8af6-5f4a8c27ead9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.152994 Aug 24 14:57:25.697635 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 620/1281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:25 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:26.718284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:26.718882 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:26.725404 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:26.725955 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:26.726425 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:26.727175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:26.727633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:26.728075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:26.863297 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:26.871693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-66a5d85d-399d-4adc-92b0-6b762713f8f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.156964 Aug 24 14:57:26.872306 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 662/1282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:26 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:27.893398 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:27.894515 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:27.896896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=2 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:27.901900 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:27.902604 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:27.903045 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:27.903741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:27.904195 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:27.904629 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:28.049459 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:28.057615 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fdb2b132-d91e-4d6f-9da9-b1b3470adbad tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.168200 Aug 24 14:57:28.058904 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 621/1283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:27 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:29.079728 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:29.080325 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:29.086998 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:29.087486 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:29.087921 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:29.088613 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:29.089066 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:29.090112 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:29.227146 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:29.235277 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4f5cd0fa-0ae7-44b2-a251-6938dd1bec31 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.159379 Aug 24 14:57:29.235855 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 663/1284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:29 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:57:30.256598 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:30.257218 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:30.259575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell0:SELECT=8 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:30.264925 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:30.265407 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:30.266238 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:30.266552 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:30.266999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:30.267423 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:30.404423 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:30.412076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-62bc2f1b-7044-42d0-9eb8-71ff11a553d4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.159290 Aug 24 14:57:30.412635 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 622/1285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:30 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:31.432709 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:31.433487 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:31.435902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell0:SELECT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:31.441212 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:31.441694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:31.442199 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:31.442896 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:31.443342 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:31.443759 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:31.579423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:31.587439 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-67c2c0a2-3922-4187-b315-e1598f0cd351 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.158564 Aug 24 14:57:31.588006 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 664/1286] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:31 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 14:57:32.609840 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:32.610464 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:32.616995 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:32.617466 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:32.617933 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:32.618647 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:32.619246 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:32.619668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:32.757511 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:32.765993 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-26cb4269-70f1-426c-a313-cb2c3a00d172 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.160985 Aug 24 14:57:32.766561 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 623/1287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:32 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:33.788343 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:33.788956 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:33.796454 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:33.796946 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:33.797372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:33.798246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:33.798697 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:33.799231 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:33.940188 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:33.947961 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-260afe16-4bad-478f-b305-a38eb73f5be7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.163557 Aug 24 14:57:33.948570 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 665/1288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:33 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:34.969524 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:34.970166 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:34.976815 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:34.977295 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:34.977726 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:34.978444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:34.978902 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:34.979317 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:35.116864 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:35.125499 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-91905324-d200-4527-9804-b242010bfeab tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.159907 Aug 24 14:57:35.126103 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 624/1289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:34 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:35.772239 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-2b8ae755-150f-4be9-9c15-428df6265d46 req-4588c29c-9b4e-4f48-bfdd-6e072eb42d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fea163-b862-4e92-99c1-0cbac9b9f353", "name": "network-vif-plugged", "status": "completed", "tag": "c9e8299e-8cc5-49f2-b548-617eecfa78b3"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:57:35.781685 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2b8ae755-150f-4be9-9c15-428df6265d46 req-4588c29c-9b4e-4f48-bfdd-6e072eb42d96 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:35.782348 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2b8ae755-150f-4be9-9c15-428df6265d46 req-4588c29c-9b4e-4f48-bfdd-6e072eb42d96 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:35.782788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-2b8ae755-150f-4be9-9c15-428df6265d46 req-4588c29c-9b4e-4f48-bfdd-6e072eb42d96 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:35.794960 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-2b8ae755-150f-4be9-9c15-428df6265d46 req-4588c29c-9b4e-4f48-bfdd-6e072eb42d96 service nova] Creating event network-vif-plugged:c9e8299e-8cc5-49f2-b548-617eecfa78b3 for instance 60fea163-b862-4e92-99c1-0cbac9b9f353 on hv-cinder-75671 Aug 24 14:57:35.799893 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-2b8ae755-150f-4be9-9c15-428df6265d46 req-4588c29c-9b4e-4f48-bfdd-6e072eb42d96 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089390 Aug 24 14:57:35.800473 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 666/1290] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:57:36.146789 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:36.147378 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:36.154480 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:36.156724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:36.156724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:36.156724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:36.156724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:36.157151 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:36.358991 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:36.367102 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-c73c327e-8c98-44bd-bd63-d377df24ab37 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.224133 Aug 24 14:57:36.367669 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 625/1291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:36 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:37.388639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:37.389328 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:37.395571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:37.396051 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:37.396483 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:37.397174 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:37.397625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:37.398075 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:37.534963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:37.543894 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-cb39aff8-f882-4236-8510-2db28ce46e7b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1260 microversion: 2.1 time: 0.159797 Aug 24 14:57:37.544459 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 667/1292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:37 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:38.564665 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:38.565275 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:38.571801 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:38.572272 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:38.572695 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:38.574086 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:38.574509 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:38.575057 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:38.710422 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:38.719141 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d6c70c5a-8ff7-4c7d-9243-b923b20496f5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1445 microversion: 2.1 time: 0.158425 Aug 24 14:57:38.719704 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 626/1293] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:38 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:38.739928 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:57:38.740535 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:57:38.747650 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:38.748125 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:38.748558 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:38.749243 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:38.749698 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:38.750150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:38.887672 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:57:38.895887 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-70335086-8d79-4b70-8501-25f5e43df28d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1445 microversion: 2.1 time: 0.159790 Aug 24 14:57:38.896490 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 668/1294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:57:38 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:57:41.354449 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-b6a5f95d-53c1-460a-873f-272b2f21a4d4 req-7d67aeb7-4161-4cbc-a59d-212785e2c672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fea163-b862-4e92-99c1-0cbac9b9f353", "tag": "c9e8299e-8cc5-49f2-b548-617eecfa78b3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:57:41.369590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b6a5f95d-53c1-460a-873f-272b2f21a4d4 req-7d67aeb7-4161-4cbc-a59d-212785e2c672 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:57:41.369590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b6a5f95d-53c1-460a-873f-272b2f21a4d4 req-7d67aeb7-4161-4cbc-a59d-212785e2c672 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:57:41.369590 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-b6a5f95d-53c1-460a-873f-272b2f21a4d4 req-7d67aeb7-4161-4cbc-a59d-212785e2c672 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:57:41.378133 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-b6a5f95d-53c1-460a-873f-272b2f21a4d4 req-7d67aeb7-4161-4cbc-a59d-212785e2c672 service nova] Creating event network-changed:c9e8299e-8cc5-49f2-b548-617eecfa78b3 for instance 60fea163-b862-4e92-99c1-0cbac9b9f353 on hv-cinder-75671 Aug 24 14:57:41.384029 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-b6a5f95d-53c1-460a-873f-272b2f21a4d4 req-7d67aeb7-4161-4cbc-a59d-212785e2c672 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 Aug 24 14:57:41.384563 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 627/1295] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 14:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 14:58:16.465995 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:58:16.466647 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 14:58:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:44.810258 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:59:44.810994 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 14:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:47.472051 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 14:59:47.472662 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Wed Aug 24 14:59:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 14:59:55.410584 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR oslo.messaging._drivers.impl_rabbit [-] [74c45570-531d-499a-8048-6bcb58f2ac17] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 14:59:55.411318 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=24 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:55.412071 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=52 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:55.416749 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 14:59:55.426260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:59:55.426260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:55.426260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:55.426260 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:55.426675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:55.426675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:55.426675 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:55.449082 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.objects.instance [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lazy-loading 'flavor' on Instance uuid 60fea163-b862-4e92-99c1-0cbac9b9f353 {{(pid=132890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 14:59:55.787205 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-1bc1bf3b-17d5-480c-9077-626f589e5170 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "POST /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353/action" status: 202 len: 0 microversion: 2.1 time: 0.378369 Aug 24 14:59:55.787836 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 669/1296] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 14:59:55 2022] POST /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 14:59:55.794608 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: ERROR oslo.messaging._drivers.impl_rabbit [-] [249ba119-37d0-454a-932e-434c848efb5d] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 14:59:55.795233 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:55.795978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=58 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:55.800304 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:59:55.801196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:59:55.810764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:55.811249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:55.811678 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:55.812380 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:55.812831 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:55.813255 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:56.007435 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:59:56.017156 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-83ecf167-8897-4c79-ac28-fca38de00a3c tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.223897 Aug 24 14:59:56.017345 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 628/1297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:59:55 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:59:57.039142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:59:57.039829 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:59:57.047135 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:57.047608 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:57.048036 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:57.048734 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:57.049179 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:57.049595 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:57.052958 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] [74c45570-531d-499a-8048-6bcb58f2ac17] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53860. Aug 24 14:59:57.232852 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:59:57.240536 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3d23e6d1-a40a-4142-91f8-c2f88a567703 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.206878 Aug 24 14:59:57.241087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 670/1298] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:59:57 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:59:58.262566 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:59:58.263236 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:59:58.277444 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:58.278350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:58.279093 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:58.280315 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:58.280819 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:58.281249 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:58.287923 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] [249ba119-37d0-454a-932e-434c848efb5d] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53868. Aug 24 14:59:58.428744 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:59:58.437334 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-30e1afe4-e3f7-4342-9beb-4c4ae3f39dd9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.179478 Aug 24 14:59:58.437930 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 629/1299] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:59:58 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 14:59:59.458979 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 14:59:59.459573 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 14:59:59.467000 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:59.467483 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:59.467918 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:59.468606 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 14:59:59.469054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 14:59:59.469474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 14:59:59.612321 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 14:59:59.620560 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3c101945-0ba4-42c4-8950-171dc4aa95df tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.165511 Aug 24 14:59:59.621132 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 671/1300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 14:59:59 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:00.642768 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:00.643359 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:00.650392 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:00.651225 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:00.651679 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:00.652385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:00.652896 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:00.653396 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:00.791284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:00.798960 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-fccc1368-c8c3-4723-8716-63272e50883d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.160164 Aug 24 15:00:00.799522 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 630/1301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:00 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:01.819701 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:01.822699 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:01.826711 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:01.827190 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:01.827625 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:01.828317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:01.828768 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:01.829206 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:01.964812 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:01.972736 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4573d1b8-b86c-4c97-b683-90bffcefd7d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.156838 Aug 24 15:00:01.973294 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 672/1302] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:01 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:02.995123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:02.995741 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:03.002099 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:03.002572 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:03.003002 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:03.003675 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:03.004116 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:03.004530 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:03.137860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:03.145528 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-cf044b2f-b031-4f24-b5fa-f3afb0d16989 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.154946 Aug 24 15:00:03.149860 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 631/1303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:02 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:04.167778 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:04.168413 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:04.174804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:04.175284 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:04.175711 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:04.176400 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:04.176845 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:04.177259 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:04.313317 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:04.320970 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-47b12d0a-c83d-4e19-a37a-b9258593e4d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.157712 Aug 24 15:00:04.328788 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 673/1304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:04 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:05.343150 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:05.343737 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:05.350668 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:05.351152 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:05.351581 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:05.352312 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:05.352769 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:05.353192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:05.485642 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:05.493975 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-e988e60f-d997-42b4-abd6-35b8a1f57cd1 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.154047 Aug 24 15:00:05.494544 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 632/1305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:05 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:00:06.516694 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:06.517423 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:06.523223 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:06.523695 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:06.524120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:06.525379 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:06.525851 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:06.526273 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:06.742286 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:06.751936 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-dc2bab28-c21c-4289-a8c5-8dbdc5a7017b tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.239739 Aug 24 15:00:06.752513 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 674/1306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:06 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:07.774640 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:07.775397 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:07.781838 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:07.782322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:07.782754 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:07.783454 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:07.783907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:07.784331 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:07.925842 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:07.934689 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-aec33782-ad95-40c4-a743-b9f54c378c51 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.164047 Aug 24 15:00:07.935272 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 633/1307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:07 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:08.956712 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:08.957268 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:08.964519 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:08.964998 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:08.965429 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:08.966141 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:08.966636 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:08.967059 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:09.104973 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:09.112772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8c7b7fc0-1982-4604-9506-8954b285cc8d tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.160004 Aug 24 15:00:09.113329 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 675/1308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:08 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:10.135485 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:10.136123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:10.142965 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:10.143445 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:10.143876 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:10.144566 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:10.145018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:10.145437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:10.283344 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:10.291867 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f63f5076-f25e-4f22-b90f-205f5ef090b7 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1510 microversion: 2.1 time: 0.161077 Aug 24 15:00:10.296593 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 634/1309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:10 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:10.313039 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:00:10.313639 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:10.320088 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:10.320569 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:10.321003 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:10.321767 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:10.322171 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:10.322597 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:10.405246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132890) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 15:00:10.676098 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-7e9d6b8f-d230-4015-96ae-4b0f8dbbd536 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "POST /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353/action" status: 202 len: 0 microversion: 2.1 time: 0.366817 Aug 24 15:00:10.676633 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 676/1310] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 15:00:10 2022] POST /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:00:10.685402 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:10.686121 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:10.692188 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:10.692821 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:10.693368 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:10.694107 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:10.694623 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:10.695106 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:10.831653 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:10.840010 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-3afbddd4-68cf-4782-8acb-b064b8c4f0a5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1518 microversion: 2.1 time: 0.159199 Aug 24 15:00:10.843541 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 635/1311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:10 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:11.867027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:11.867027 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:11.869283 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:11.869870 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:11.870375 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:11.871108 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:11.871562 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:11.872025 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:12.022004 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:12.029952 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-6595e6e8-6043-4901-99af-6a444ae065b0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1518 microversion: 2.1 time: 0.172271 Aug 24 15:00:12.030508 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 677/1312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:11 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:12.173450 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-5d596051-5896-4bdf-9ebd-f351023a6202 req-4446b489-f7c9-4d88-bf10-68732de32e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fea163-b862-4e92-99c1-0cbac9b9f353", "name": "network-vif-unplugged", "status": "completed", "tag": "c9e8299e-8cc5-49f2-b548-617eecfa78b3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:00:12.184149 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-5d596051-5896-4bdf-9ebd-f351023a6202 req-4446b489-f7c9-4d88-bf10-68732de32e23 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:12.184606 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-5d596051-5896-4bdf-9ebd-f351023a6202 req-4446b489-f7c9-4d88-bf10-68732de32e23 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:12.185026 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-5d596051-5896-4bdf-9ebd-f351023a6202 req-4446b489-f7c9-4d88-bf10-68732de32e23 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:12.196800 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.compute.server_external_events [req-5d596051-5896-4bdf-9ebd-f351023a6202 req-4446b489-f7c9-4d88-bf10-68732de32e23 service nova] Unable to find a host for instance 60fea163-b862-4e92-99c1-0cbac9b9f353. Dropping event network-vif-unplugged {{(pid=132892) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 15:00:12.197781 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-5d596051-5896-4bdf-9ebd-f351023a6202 req-4446b489-f7c9-4d88-bf10-68732de32e23 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028443 Aug 24 15:00:12.198346 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 636/1313] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 15:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 15:00:13.052962 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:13.053802 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:13.060404 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:13.060895 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:13.061332 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:13.062056 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:13.062515 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:13.062963 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:13.201865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:13.209902 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-8385bdd8-61ca-4877-9146-b408d3d886be tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1520 microversion: 2.1 time: 0.160995 Aug 24 15:00:13.210463 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 678/1314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:13 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:14.232667 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:14.233281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:14.239683 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:14.240157 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:14.240588 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:14.241275 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:14.241724 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:14.242196 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:14.394600 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:14.403214 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-4d29d3b5-630f-4c9b-8d20-bdf6d5753c33 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.174282 Aug 24 15:00:14.403789 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 637/1315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:14 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:15.426142 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:15.426780 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:15.433524 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:15.434133 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:15.434570 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:15.435266 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:15.435717 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:15.436140 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:15.567747 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:15.576001 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-e42a2f1e-87dd-44c6-ac0a-cca4de592fff tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.153998 Aug 24 15:00:15.576567 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 679/1316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:15 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:00:16.598018 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:16.598638 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:16.605565 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:16.606060 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:16.606487 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:16.607399 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:16.607931 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:16.608353 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:16.744135 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:16.751764 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a8ac44f5-dd31-4013-96bc-71f1950cd616 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.157637 Aug 24 15:00:16.752328 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 638/1317] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:16 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:17.773229 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:17.773853 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:17.780358 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:17.780823 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:17.781256 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:17.782058 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:17.782509 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:17.782935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:17.917669 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:17.925414 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-2ccb6e06-875d-4f1e-8158-ff767e48c8f2 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.156167 Aug 24 15:00:17.926005 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 680/1318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:17 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:18.948502 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:18.949097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:18.955606 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:18.956079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:18.956506 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:18.957182 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:18.957627 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:18.958076 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:19.096227 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:19.103907 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-a60e7aa3-8f91-4918-9530-150854ab59e9 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.160168 Aug 24 15:00:19.104479 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 639/1319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:18 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:20.125292 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:20.125908 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:20.132246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:20.132718 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:20.133150 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:20.133894 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:20.134352 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:20.134772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:20.272077 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:20.280640 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-4bd83846-47a7-4907-aa6f-be863b723995 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.159165 Aug 24 15:00:20.282757 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 681/1320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:20 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:21.306279 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:21.306915 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:21.313248 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:21.313722 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:21.314213 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:21.314880 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:21.315322 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:21.315737 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:21.445217 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:21.453063 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-408b36b9-fc1d-4b10-90a4-fd4e2bdd1993 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.151228 Aug 24 15:00:21.453825 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 640/1321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:21 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:22.474834 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:22.475371 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:22.482068 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:22.482550 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:22.482987 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:22.483674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:22.484130 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:22.484555 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:22.503078 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:22.624801 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:22.632806 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-3bcfa53d-e5f4-4de6-a412-8a075c053f03 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.161886 Aug 24 15:00:22.633409 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 682/1322] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:22 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:23.655901 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:23.656460 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:23.662950 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:23.665427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:23.665427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:23.665427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:23.665427 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:23.665897 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:23.799284 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:23.807384 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-f91dfedb-d53a-4402-83a1-f789c5ed2878 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.155605 Aug 24 15:00:23.807953 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 641/1323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:23 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:24.244110 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-df769079-a7ed-4140-9b0b-7be74f2ca909 req-eb0c7473-b5b9-42fc-926e-a8b9bf700dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fea163-b862-4e92-99c1-0cbac9b9f353", "name": "network-vif-plugged", "status": "completed", "tag": "c9e8299e-8cc5-49f2-b548-617eecfa78b3"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:00:24.254218 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-df769079-a7ed-4140-9b0b-7be74f2ca909 req-eb0c7473-b5b9-42fc-926e-a8b9bf700dd5 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:24.254693 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-df769079-a7ed-4140-9b0b-7be74f2ca909 req-eb0c7473-b5b9-42fc-926e-a8b9bf700dd5 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:24.255120 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-df769079-a7ed-4140-9b0b-7be74f2ca909 req-eb0c7473-b5b9-42fc-926e-a8b9bf700dd5 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:24.266935 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-df769079-a7ed-4140-9b0b-7be74f2ca909 req-eb0c7473-b5b9-42fc-926e-a8b9bf700dd5 service nova] Creating event network-vif-plugged:c9e8299e-8cc5-49f2-b548-617eecfa78b3 for instance 60fea163-b862-4e92-99c1-0cbac9b9f353 on hv-cinder-75671 Aug 24 15:00:24.272017 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-df769079-a7ed-4140-9b0b-7be74f2ca909 req-eb0c7473-b5b9-42fc-926e-a8b9bf700dd5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Aug 24 15:00:24.275164 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 683/1324] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 15:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:00:24.829110 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:24.829740 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:24.837111 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:24.837641 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:24.838123 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:24.838809 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:24.839256 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:24.839672 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:24.969474 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:24.977208 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-d65289ee-4ed5-4b5e-9b8e-4c7f10d43516 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.151928 Aug 24 15:00:24.978418 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 642/1325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:24 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:26.000424 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:26.001031 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:26.002968 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:26.007813 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:26.008316 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:26.008911 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:26.009781 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:26.010240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:26.010670 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:26.147804 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:26.155656 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-97a7e951-8b7a-4b77-a409-cbdcf95d83f4 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1576 microversion: 2.1 time: 0.160018 Aug 24 15:00:26.156214 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 684/1326] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:25 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:00:27.178097 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:00:27.178714 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:00:27.181650 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=31 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:27.186371 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:27.186850 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:27.187281 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:27.187967 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:00:27.188436 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:00:27.188836 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:00:27.191433 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=87 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:27.326732 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:00:27.334461 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-03edde81-cf0a-4e0a-9208-07fa6cdeaf6a tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1563 microversion: 2.1 time: 0.160344 Aug 24 15:00:27.335137 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 643/1327] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:00:27 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:01:23.836350 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:01:23.837266 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Wed Aug 24 15:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:01:57.237587 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_api:SELECT=1 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:57.238357 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG dbcounter [-] [132892] Writing DB stats nova_cell1:SELECT=5 {{(pid=132892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:57.242401 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_api:SELECT=1 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:57.243147 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG dbcounter [-] [132890] Writing DB stats nova_cell1:SELECT=10 {{(pid=132890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:57.248920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:01:57.249999 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:01:57.256160 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:01:57.256909 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:01:57.257541 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:01:57.258474 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:01:57.259128 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:01:57.259745 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:01:57.287384 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Going to try to terminate instance {{(pid=132890) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:01:57.316884 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [req-85161218-3415-403f-b1f4-e3d44210a373 req-a21e2274-1e31-462d-a4aa-d54a7cd1b587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fea163-b862-4e92-99c1-0cbac9b9f353", "tag": "c9e8299e-8cc5-49f2-b548-617eecfa78b3"}]} {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:01:57.329131 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-85161218-3415-403f-b1f4-e3d44210a373 req-a21e2274-1e31-462d-a4aa-d54a7cd1b587 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:01:57.329685 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-85161218-3415-403f-b1f4-e3d44210a373 req-a21e2274-1e31-462d-a4aa-d54a7cd1b587 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:01:57.330146 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [req-85161218-3415-403f-b1f4-e3d44210a373 req-a21e2274-1e31-462d-a4aa-d54a7cd1b587 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:01:57.355089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.compute.server_external_events [req-85161218-3415-403f-b1f4-e3d44210a373 req-a21e2274-1e31-462d-a4aa-d54a7cd1b587 service nova] Creating event network-changed:c9e8299e-8cc5-49f2-b548-617eecfa78b3 for instance 60fea163-b862-4e92-99c1-0cbac9b9f353 on hv-cinder-75671 Aug 24 15:01:57.355089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [req-85161218-3415-403f-b1f4-e3d44210a373 req-a21e2274-1e31-462d-a4aa-d54a7cd1b587 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111945 Aug 24 15:01:57.355089 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 644/1328] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 15:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:01:57.802929 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-312e7b38-0ba4-4b8f-8d23-f5463dade6f8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "DELETE /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 204 len: 0 microversion: 2.1 time: 0.569159 Aug 24 15:01:57.806844 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 685/1329] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 15:01:57 2022] DELETE /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:01:57.814814 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:01:57.815949 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:01:57.822616 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:01:57.823382 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:01:57.823990 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:01:57.824746 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:01:57.825526 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:01:57.826408 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:01:58.001192 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:01:58.011125 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-654d068d-367d-421a-9ede-5cded582227e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1569 microversion: 2.1 time: 0.202512 Aug 24 15:01:58.011708 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 645/1330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:01:57 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:01:59.034070 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:01:59.034772 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:01:59.041475 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:01:59.042069 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:01:59.042506 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:01:59.043210 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:01:59.043674 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:01:59.044241 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:01:59.195117 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.policy [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132890) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:01:59.204175 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-571aea11-5e02-41ff-929b-294cfcf90617 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1451 microversion: 2.1 time: 0.174522 Aug 24 15:01:59.204771 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 686/1331] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:01:59 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:02:00.226539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:02:00.227437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:02:00.234795 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:02:00.236437 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:02:00.236874 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:02:00.237602 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:02:00.238079 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:02:00.238529 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:02:00.344780 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:02:00.363366 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-dd82c5aa-a5aa-4367-bcfd-c1c2544c3fb0 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1383 microversion: 2.1 time: 0.140966 Aug 24 15:02:00.373792 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 646/1332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:02:00 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1383 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:02:00.405014 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [req-d1eb92e6-590a-4953-9db5-e4e968513eaf req-10fbd6ff-3dde-45aa-9d91-8f91c4030553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fea163-b862-4e92-99c1-0cbac9b9f353", "name": "network-vif-deleted", "tag": "c9e8299e-8cc5-49f2-b548-617eecfa78b3"}]} {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:02:00.417324 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-d1eb92e6-590a-4953-9db5-e4e968513eaf req-10fbd6ff-3dde-45aa-9d91-8f91c4030553 service nova] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:02:00.418033 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-d1eb92e6-590a-4953-9db5-e4e968513eaf req-10fbd6ff-3dde-45aa-9d91-8f91c4030553 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:02:00.418545 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [req-d1eb92e6-590a-4953-9db5-e4e968513eaf req-10fbd6ff-3dde-45aa-9d91-8f91c4030553 service nova] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:02:00.431247 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.compute.server_external_events [req-d1eb92e6-590a-4953-9db5-e4e968513eaf req-10fbd6ff-3dde-45aa-9d91-8f91c4030553 service nova] Creating event network-vif-deleted:c9e8299e-8cc5-49f2-b548-617eecfa78b3 for instance 60fea163-b862-4e92-99c1-0cbac9b9f353 on hv-cinder-75671 Aug 24 15:02:00.437571 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [req-d1eb92e6-590a-4953-9db5-e4e968513eaf req-10fbd6ff-3dde-45aa-9d91-8f91c4030553 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035546 Aug 24 15:02:00.439054 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 687/1333] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 15:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:02:01.385973 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:02:01.386539 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.compute.api [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132892) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:02:01.394488 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:02:01.394978 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:02:01.396136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:02:01.396136 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:02:01.396566 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:02:01.396990 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG oslo_concurrency.lockutils [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:02:01.464999 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.policy [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b1bc724974112972af06eb577ffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62ff2597c94498ca5f9873d87edba22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132892) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:02:01.473808 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-b08a2d08-89f7-4c3f-bd71-021d9363363e tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 200 len: 1219 microversion: 2.1 time: 0.091761 Aug 24 15:02:01.474385 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 647/1334] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:02:01 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:02:02.496087 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '>' {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:02:02.496769 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.compute.api [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] [instance: 60fea163-b862-4e92-99c1-0cbac9b9f353] Fetching instance by UUID {{(pid=132890) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:02:02.503285 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:02:02.503798 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:02:02.504498 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:02:02.504920 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Acquiring lock "394a1067-454b-4b02-98e2-91da0c17a51a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:02:02.505372 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:02:02.505810 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG oslo_concurrency.lockutils [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Lock "394a1067-454b-4b02-98e2-91da0c17a51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:02:02.519662 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.wsgi [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] HTTP exception thrown: Instance 60fea163-b862-4e92-99c1-0cbac9b9f353 could not be found. Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Request method failure captured: Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: request: GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 HTTP/1.1 Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept: application/json Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Accept-Encoding: identity Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Connection: close Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Length: 0 Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Content-Type: application/json Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Host: 10.222.0.65 Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Openstack-System-Scope: None Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: User-Agent: python-urllib3/1.26.11 Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Auth-Token: gAAAAABjBjwsyoGe6cDHTKB1D1X5tvMjEHTBxIQvhaSF-7EXqAlUu6nmpsLCw6eWpp3y2QQGqt9yTFZZp_RgMMt1NOyqIPZJqX3TZPczjHHjV_dPJbKenJrSkejHa06c5BMc8mtm70Pm0yWlBG0f_ccceEiVIkMBBXRbwlGVh_nux3G-Dw_fZmM Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Id: None Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Domain-Name: None Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Identity-Status: Confirmed Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Is-Admin-Project: True Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Id: default Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Domain-Name: Default Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Id: c62ff2597c94498ca5f9873d87edba22 Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Project-Name: tempest-TestShelveInstance-76278854 Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Role: member,reader Aug 24 15:02:02.521235 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Roles: member,reader Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c62ff2597c94498ca5f9873d87edba22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c62ff2597c94498ca5f9873d87edba22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c62ff2597c94498ca5f9873d87edba22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c62ff2597c94498ca5f9873d87edba22"}]}] Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant: tempest-TestShelveInstance-76278854 Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Id: c62ff2597c94498ca5f9873d87edba22 Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-Tenant-Name: tempest-TestShelveInstance-76278854 Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User: tempest-TestShelveInstance-76278854-project Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Id: default Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Domain-Name: Default Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Id: 9b3b1bc724974112972af06eb577ffe1 Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: X-User-Name: tempest-TestShelveInstance-76278854-project Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: method: > Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: exception: Instance 60fea163-b862-4e92-99c1-0cbac9b9f353 could not be found. Aug 24 15:02:02.523096 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: action_args: {'id': '60fea163-b862-4e92-99c1-0cbac9b9f353'} Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: {{(pid=132890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fea163-b862-4e92-99c1-0cbac9b9f353 could not be found. Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:02:02.524178 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fea163-b862-4e92-99c1-0cbac9b9f353 could not be found. Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fea163-b862-4e92-99c1-0cbac9b9f353 could not be found. Aug 24 15:02:02.525938 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: ERROR nova.api.openstack.wsgi Aug 24 15:02:02.527688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: DEBUG nova.api.openstack.wsgi [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Returning 404 to user: Instance 60fea163-b862-4e92-99c1-0cbac9b9f353 could not be found. {{(pid=132890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:02:02.527688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO nova.api.openstack.requestlog [None req-0f740efe-032b-4e80-8b3c-8a7b905309d5 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353" status: 404 len: 111 microversion: 2.1 time: 0.031295 Aug 24 15:02:02.527688 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: [pid: 132890|app: 0|req: 688/1335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 15:02:02 2022] GET /compute/v2.1/servers/60fea163-b862-4e92-99c1-0cbac9b9f353 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:02:02.746728 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: DEBUG nova.api.openstack.wsgi [None req-139950fd-f3c9-4a8d-98b2-3ba09f7715c8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] Calling method '.version_select at 0x7fbf78176b80>' {{(pid=132892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:02:02.844547 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO nova.api.openstack.requestlog [None req-139950fd-f3c9-4a8d-98b2-3ba09f7715c8 tempest-TestShelveInstance-76278854 tempest-TestShelveInstance-76278854-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1486306073" status: 202 len: 0 microversion: 2.1 time: 0.102153 Aug 24 15:02:02.845138 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: [pid: 132892|app: 0|req: 648/1336] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Aug 24 15:02:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1486306073 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:03:04.818808 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:03:04.819478 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 15:03:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:03:07.480575 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:03:07.481811 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Wed Aug 24 15:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:03:16.475427 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:03:16.476052 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 15:03:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:04:43.844756 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:04:43.845395 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Wed Aug 24 15:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:05:02.863692 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:05:02.864280 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 15:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:05:12.572325 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:05:12.572885 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Wed Aug 24 15:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:06:24.827240 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:06:24.827869 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 15:06:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:06:27.489392 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:06:27.490104 dv-cinder-756710-6-iscsi devstack@n-api.service[132892]: Wed Aug 24 15:06:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:06:36.485246 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:06:36.485865 dv-cinder-756710-6-iscsi devstack@n-api.service[132890]: Wed Aug 24 15:06:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!